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Abstract — We consider a communication system where a relay 
helps transmission of messages from a sender to a receiver. The 
relay is considered not only as a helper but as a wire-tapper who 
can obtain some knowledge about transmitted messages. In this 
paper we study a relay channel with confidential messages(RCC), 
where a sender attempts to transmit common information to both 
a receiver and a relay and also has private information intended 
for the receiver and confidential to the relay. The level of secrecy 
of private information confidential to the relay is measured by 
the equivocation rate, i.e., the entropy rate of private information 
conditioned on channel outputs at the relay. The performance 
measure of interest for the RCC is the rate triple that includes 
the common rate, the private rate, and the equivocation rate as 
components. The rate-equivocation region is defined by the set 
that consists of all these achievable rate triples. In this paper 
we give two definitions of the rate-equivocation region. We first 
define the rate-equivocation region in the case of deterministic 
encoder and call it the deterministic rate-equivocation region. 
Next, we define the rate-equivocation region in the case of 
stochastic encoder and call it the stochastic rate-equivocation 
region. We derive explicit inner and outer bounds for the above 
two rate-equivocation regions. On the deterministic/stochastic 
rate-equivocation region we present two classes of relay channels 
where inner and outer bounds match. We also evaluate the 
deterministic and stochastic rate-equivocation regions of the 
Gaussian RCC. 

Index Terms — Relay channel, confidential messages, informa- 
tion security 



I. Introduction 

Security of communications can be studied from informa- 
tion theoretical viewpoint by regarding them as a communi- 
cation system in which some messages transmitted through 
channel should be confidential to anyone except for authorized 
receivers. 

Information theoretical approach to security problem in 
communications was first attempted by Shannon [1]. He 
discussed a theoretical model of cryptosystems using the 
framework of classical one way noiseless channels and derived 
some conditions for secure communication. Yamamoto [2], [3] 
investigated some extensions of Shannon's cipher system. 

Various types of multi-terminal communication systems 
have been investigated so far in the field of multi-user in- 
formation theory. In those systems we can consider the case 
where a confidentiality of transmitted messages is required 
from standpoint of security. In this case it is of importance to 
analyze security of communications from viewpoint of multi- 
user information theory. 
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The security of communication for the broadcast channel 
was studied by Wyner [4] and Csiszar and Korner [5]. Ya- 
mamoto [6]-[10] studied several secure communication sys- 
tems under the framework of multi-terminal source or channel 
coding systems. Maurer [11], Ahlswede and Csiszar [12], 
Csiszar and Narayan [13]-[15], studied public key agree- 
ments under the framework of multi-user information theory. 
Oohama [16] discussed the security of communication for the 
relay channel. He posed and investigated the relay channel 
with confidential messages, where the relay acts as both a 
helper and a wire-tapper. Subsequently, the above security 
problem in relay communication was studied in detail by 
Oohama [17] and He and Yener [18], [19]. Liang and Poor 
[20] discussed the security of communication for the multiple 
access channel. They formulated and studied the multiple 
access channel with confidential messages. Liu et al. [21] 
considered interference and broadcast channels with confiden- 
tial messages. Tekin and Yener [22] studied general Gaussian 
multiple access and two way wire tap channels. Lai and El 
Gamal [23] investigated the security of relay channels in a 
problem set up different form [16]. 

In this paper we discuss the security of communication for 
the relay channel under the framework that Oohama introduced 
in [16]. In the relay channel a relay is considered not only as 
a sender who helps transmission of messages but as a wire- 
tapper who wish to know something about the transmitted 
messages. Coding theorem for the relay channel was first 
established by Cover and El Gamal [24]. By carefully checking 
their coding scheme used for the proof of the direct coding 
theorem, we can see that in their scheme the relay helps 
transmission of messages by learning all of them. Hence, this 
coding scheme is not adequate when some messages should 
be confidential to the relay. 

Oohama [16] studied the security of communication for 
the relay channel under the situation that some of transmitted 
messages should be confidential to the relay. For analysis of 
this situation Oohama posed the communication system called 
the relay channel with confidential messages or briefly said the 
RCC. In the RCC, a sender wishes to transmit two types of 
messages. One is a message called a common message which 
is sent to a legitimate receiver and a relay. The other is a 
message called a private message which is sent only to the 
legitimate receiver and should be confidential to the relay as 
much as possible. The level of secrecy of private information 
confidential to the relay can be measured by the equivocation 
rate, i.e., the entropy rate of private messages conditioned 
on channel outputs at the relay. The performance measure 
of interest is the rate triple that includes the transmission 
rates of common and private messages and the equivocation 
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rate as components. We refer to the set that consists of all 
achievable rate triples as the rate-equivocation region. Oohama 
[16] derived an inner bound of the rate-equivocation region. 

In this paper we study the coding problem of the RCC. 
In general two cases of encoding can be considered in the 
problem of channel coding. One is a case where deterministic 
encoders are used for transmission of messages and the other is 
a case where stochastic encoders are used. It is well known that 
for problems involving secrecy, randomization of encoding 
enhances the security of communication. From this reason, 
stochastic encoding was always assumed in the previous works 
treating security problems in communication. However, in 
those works it is not clear how much advantage stochastic 
encoding can offer in secure communication. To know a 
merit of stochastic encoding precisely we must also know a 
fundamental theoretical limit of secure communication when 
encoding is restricted to be deterministic. In this paper we 
discuss security problems in the RCC in two cases. One is 
a case of deterministic encoder, where the sender must use 
a deterministic encoder. The other is a case of stochastic 
encoder, where the sender is allowed to use a stochastic 
encoder. The former case models an insecure communication 
scheme and the latter case models a secure communication 
scheme. We define two rate-equivocation regions. One is a 
rate-equivocation region in the case of deterministic encoder 
and call it the deterministic rate-equivocation region. The other 
is a rate-equivocation region in the case of stochastic encoder 
and call it the stochastic rate-equivocation region. 

In this paper, we derive several results on the deterministic 
and stochastic rate-equivocation regions. Cover and El Gamal 
[24] determined the capacity for two classes of relay channels. 
One is a degraded relay channel and the other is a reversely 
degraded channel. In the degraded relay channel, channel 
outputs obtained by the relay are less noisy than those obtained 
by the receiver. Conversely, in the reversely degraded relay 
channel, channel outputs obtained by the relay are more noisy 
than those obtained by the receiver. Our capacity results have a 
close connection with the above two classes of relay channels. 

On the deterministic rate-equivocation region, we derive two 
pairs of inner and outer bounds. On the first pair of inner 
and outer bounds we show that they match for the class of 
reversely degraded relay channels. Furthermore, we show that 
if the relay channel is degraded, no security is guaranteed for 
transmission of private messages. On the second pair of inner 
and outer bounds we show that they match for the class of 
relay channels having some deterministic component in their 
stochastic matrix. We further derive an explicit outer bound 
effective for a class of relay channels where channel outputs 
obtained by the relay depend only on channel inputs from the 
sender. 

On the stochastic rate-equivocation region, we derive two 
pairs of inner and outer bounds. On the first pair, inner 
and outer bound match for the class of reversely degraded 
channels. On the second one, inner and outer bounds match for 

'The same determination problems of the two rate-equivocation regions 
were investigated by Oohama [17]. However, his results on the deterministic 
rate-equivocation region contain some mistakes. The results on the determin- 
istic rate-equivocation we derive in this paper correct those mistakes. 



the class of semi deterministic relay channels. We show that 
when the relay channel is degraded, no security is guaranteed 
for transmission of private messages even if we use stochastic 
encoders. 

We compare the deterministic rate-equivocation region with 
the stochastic rate-equivocation region to show that the former 
is strictly smaller than the latter. It is obvious that the maxi- 
mum secrecy rate attained by the deterministic encoding does 
not exceed that of stochastic encoding. We demonstrate that 
for the reversely degraded relay channel the former is equal 
to the latter. 

When the relay is kept completely ignorant of private mes- 
sage in the RCC, we say that the prefect secrecy is established. 
We show that the prefect secrecy can hardly be attained by 
the deterministic encoder. In the case of stochastic encoder 
the secrecy capacity is defined by the maximum transmission 
rate of private message under the condition of prefect secrecy. 
From the results on the stochastic rate-equivocation regions, 
we can obtain inner and outer bounds of the stochastic secrecy 
capacities. In particular, when the relay channel is reversely 
degraded or semi deterministic, we determine the stochastic 
secrecy capacity. 

We also study the Gaussian RCC, where transmissions 
are corrupted by additive Gaussian noise. We evaluate the 
deterministic and stochastic rate-equivocation regions of the 
Gaussian RCC. For each rate-equivocation we derive a pair 
of explicit inner and outer bounds to show that those bounds 
match for the class of reversely degraded relay channels. 

On our results on the inner bounds of the rate-equivocation 
region we give their rigorous proofs. The method Csiszar 
and Korner [5] used for computation of the equivocation 
is a combinatorial method based on the type of sequences 
[25]. Their method has a problem that it is not directly 
applicable to the Gaussian case. To overcome this problem we 
introduce a new unified way of estimating error probabilities 
and equivocation rate for both discrete and Gaussian cases. 
Our method is based on the information spectrum method 
introduced and developed by Han [26]. Our derivation of the 
inner bounds is simple and straightforward without using any 
particular property on the sets of jointly typical sequences. 

In the RCC, the relay also act as a receiver with respect 
to the common message. This implies that when there is no 
security requirement in the RCC, its communication scheme 
is equal to that of a special case of cooperative relay broad- 
cast channels(RBCs) posed and investigated by Liang and 
Veeravalli [27] and Liang and Kramer [28]. Cooperation 
and security are two important features in communication 
networks. Coding problems for the RCC provide an interesting 
interplay between cooperation and security. 

II. Relay Channels with Confidential Messages 

Let X,S,y, Z be finite sets. The relay channel dealt with 
in this paper is defined by a discrete memoryless channel 
specified with the following stochastic matrix: 

r = {r(y, z I x, s)}( Xt ^ y ^ )(£XxSx y xZ . (i) 

Let X be a random variable taking values in X and X" = 
X1X2 ■ ■ ■ X n be a random vector taking values in X n . We 
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Fig. 1. Channel inputs and outputs at the ith transmission. 
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Fig. 2. Transmission of messages via relay channel using {fn, {<?i}" =1 i 



write an element of X n as x = x\Xi • • ■ x n . Similar notations 
are adopted for S, Y, and Z. 

In the RCC, we consider the following scenario of com- 
munication. Let K n and M n be uniformly distributed random 
variables taking values in message sets JC n and M. n , respec- 
tively. The random variable M n is a common message sent 
to a relay and a legitimate receiver. The random variable K n 
is a private message sent only to the receiver and contains 
an information confidential to the relay. A sender transforms 
K n and M n into a transmitted sequence X n using an encoder 
function /„ and sends it to the relay and the legitimate receiver. 
For the encoder function /„, we consider two cases; one is the 
case where /„ is deterministic and the other is the case where 
/„ is stochastic. In the former case f n is a one to one mapping 
from K„ x M n to X n . In the latter case /„ : K„ x M n — > X n 
is a stochastic matrix defined by 



f n (k,m) = {f n (x\k,m}} 



x£X" 



(k, m) e JC n x M T 



Here, f n (x\k, m) is a probability that the encoder f n generates 
a channel input x from the message pair (k, m). Channel 
inputs and outputs at the ith transmission is shown in Fig.Q] At 
the ith transmission, the relay observes the random sequence 
Z 1 ^ 1 = (Zi, Z 2 , ■ ■ ■ , Zi_x) transmitted by the sender through 
noisy channel, encodes them into the random variable Si and 
sends it to the receiver. 

The relay also wishes to decode the common message from 
observed channel outputs. The encoder function at the relay 
is defined by the sequence of functions {gi}" =1 . Each gi is 
defined by gi : Z' 1 ^ 1 — » S. Note that the channel input Si 
that the relay sends at the ith transmission depends solely on 
the output random sequence Z' 1 ^ 1 that the relay previously 
obtained as channel outputs. The decoding functions at the 
legitimate receiver and the relay are denoted by ijj n and cp n , 
respectively. Those functions are formally defined by ip n : 
y n — > fC n xA4 n ,tp n : Z n -> A1 n . Transmission of messages 
via relay channel using (/„, {g^f-i, 4>n, fn) is shown in Fig. 
|2] When /„ is a deterministic encoder, the joint probability 



mass function on fC n x A4 n x y n x Z n is given by 

Pr{(K n ,M n ,Y n ,Z n ) = (k,m,y,z)} 
1 



\Kn\\M n 



~J_T(y i ,Zi\xi(k > m),g i (z t 1 )) 



where Xi(k, m) is the ith component of x = f n (k,m) and 
\K. n \ is a cardinality of the set JC n . When /„ is a stochastic 
encoder, the joint probability mass function on tC n xM„ x X n 
xy n x Z n is given by 



Pr{(K n ,M n ,X n ,Y 
f n (x\k,m ) 

\ICn\\Mr 



nn 



Z n ) = (k,m,x,y,z)} 
Ui,Zi \xi(k,m),gi(z l ~ 1 )) . 



Error probabilities of decoding at the receiver and the relay 
are defined by 

A^ n) = Pr{V„(r") + (K n ,M n )} and 



A 



respectively. 

In the RCC, the relay act as a wire-tapper with respect to the 
private message K n . The level of ignorance of the relay with 
respect to K n is measured by the equivocation rate, i.e., the 
entropy rate -H{K n \Z n ) conditioned on the channel output 
Z n at the relay. Throughout the paper, the logarithmic function 
is to the base 2. The equivocation rate should be greater than 
or equal to a prescribed positive level. 

A triple (Rq, R\ , R c ) is achievable if there exists a sequence 
of quadruples {(/„, {&}?=!! ^ n ,ip n )} c ri 



l °° =1 such that 



lim \[ n) 



lim A 



(n) 



0, 



= R 



lim — log \M 

n— foo Ti 

lim -H(K n \Z n ) > R 



lim -log\K- n \ = Ri, 

n— f oo Ji 



When /„ and {gi} n= i are restricted to be deterministic, the set 
that consists of all achievable rate triple is denoted by TvLdtT), 
which is called the deterministic rate-equivocation region of 
the RCC. When /„ is allowed to be stochastic and {gi} n= i 
is restricted to be deterministic, the set that consists of all 
achievable rate triple is denoted by TZ S (T), which is called 
the stochastic rate-equivocation region. Main results on lZd(T) 
and 7Z s (r) will be described in the next section. 

In the above problem set up the relay encoder is 
a deterministic encoder. We can also consider the case where 
we may use a stochastic encoder as {<?i}™ =1 . In this case 
the relay function g^z 1 ^ 1 ) € S, z l ~ 1 E Z' 1 ^ 1 is a stochastic 
matrix given by 

9i(z i - 1 ) = {9i(s\z i - 1 )} ses . 

Here gi(s\z' l ~ 1 ) is a conditional probability of Si = s 
conditioned on Z 1 ^ 1 = z 1 " 1 . When /„ is deterministic and 
{.9i}"=i i s stochastic, the joint probability mass function on 
JC n xM n xS n xy n x Z" is given by 

Pr{(K n ,M n ,S n ,X n ,Y n ,Z n ) = {k,m,s,y,z)} 
1 - 

= HP ii a a i TT 1 ^'^ \xz{k,m),s l )g i {s i \z 1 - 1 ). 
|a:„||A4„| " 
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When /„ and {gi}f =1 are stochastic, the joint probability mass 
function on K n x M n x5 n x X n x/' x Z n is given by 

Fr{(K n ,M n ,S n ,X n ,Y n ,Z n ) = (k,m,s,x,y,z)} 
f n (x\k,m) 



where [a] + = max{0, a}. Set 



\K. n \\M, 



~\T(yi,Zi \x i (k,m),Si)g i (s l \z l 1 ). 



Capacity results in the case of stochastic relay encoder will 
be stated in Section III-C. 

In the remaining part of this section, we state relations 
between the RCC and previous works. When |«S| = 1, T 
becomes a broadcast channel, and the coding scheme of 
the RCC coincides with that of the broadcast channel with 
confidential messages(the BCC) investigated by Csiszar and 
Korner [5]. They determined the stochastic rate-equivocation 
region for the BCC. 

Liang and Veeravalli [27] and Liang and Krammer [28] 
posed and investigated a new theoretical model of cooperative 
communication network called the partially/fully cooperative 
relay broadcast channel(RBC). The RCC can be regarded 
as a communication system where a security requirement is 
imposed on the RBC. In fact, setting 

C rbc (r) = K d (T) n {(ifc, JJi.iZe) : R c = 0}, 

Crbc(T) defines the capacity region of a special case of 
the partially cooperative RBC. Liang and Veeravalli [27] 
and Liang and Krammer [28] considered the determination 
problem of C rb c(r) and determined it for some class of relay 
channels. The determination problem of C rbc (r) for general 
r still remains open. 

III. Main Results 

In this section we state our main results. Proofs of the results 
are stated in Sections VI and VII. 



A. Deterministic Coding Case 

In this subsection we state our results on inner and outer 
bounds of 7?.d(r). Let U be an auxiliary random variable 
taking values in finite set U. Define the set of random triples 

(U, X, S) eU xX xS by 

Vi = {(U,X,S): \U\<\X\\S\+3, 

U ->XS-> YZ} , 

where U — > XS — > YZ means that random variables 
U, (X, S) and (Y, Z) form a Markov chain in this order. Set 

■rl1 n \u,X,S\T) = {(R Q ,R U R C ) : R a ,Ri,R c > 0, 



Ro < mm{I(US; Y), I(U; Z\S)} , 

Ri < I{X;Y\US) , 

Rc < [Ri-I(X;Z\US)}+.}, 



n 



(out) 



A 



{U,X,S\T) = {{Rq,R u B«) : R ,Ri,R* > 0, 

Ro < min{I(US; Y), I(U; Z\S)} , 

Ri < I(X;YZ\US), 

Ro + Ri < I(XS;Y), 

Rc < [Ri-I(X;Z\US)}+.}, 



A 



|J n^(u,x,s\r). 



K 



(out) 



(u,x,s)eTi 

(r)= (J ^ in) ([/,x,5|r). 

{U,X,S)£Vi 

Then we have the following. 

Theorem 1: For any relay channel T, 

n { i n \v) c n d {T) c 7^ out) (r). 

An essential difference between TZ^ (V) and ^^ out '(r) is 
a gap A given by 

A = I(X; Y\ZUS) - [I(X: Y\US) - I{X; Z\US)] 
= I(X; ZY\US) - I{X; Y\US) = I(X; Z\YUS) . 

Observe that 

A = H{Z\YUS) - H(Z\YXUS) 

( = } H{Z\YUS) - H(Z\YXS) 

< H{Z\YS) - H(Z\YXS) = I{X; Z\YS) . 

Equality (a) follows from the Markov condition U —¥ XS 
Y Z. Hence, A vanishes if the relay channel Y = {Y(z, y\x, s) 
}(x,s, v ,z)exxsxyxz satisfies the following: 



Y(z,y\x,s) = Y(z\y,s)Y(y\x, 



(2) 



The above condition is equivalent to the condition that 
X,S,Y,Z form a Markov chain X -t SY Z in this 
order. Cover and El. Gamal [24] called this relay channel the 
reversely degraded relay channel. On the other hand, we have 

I(X:Y\ZUS) = H(Y\ZUS) - H(Y\ZXUS) 
< H{Y\ZS) - H(Y\ZXS) = I(X; Y\ZS) , (3) 

where the last inequality follows from the Markov condition 
U — > XSZ — > Y. From (O we can see that the quantity 
I(X;Y\ZUS) vanishes if the relay channel Y satisfies the 
following: 



Y(z, y\x, s) = Y(y\z, s)Y(z\x, s). 



(4) 



Hence, if the relay channel Y satisfies then, R c should be 
zero. This implies that no security on the private messages is 
guaranteed. The condition is equivalent to the condition 
that X, S, Y, Z form a Markov chain X -> SZ -> Y in this 
order. Cover and El. Gamal [24] called this relay channel the 
degraded relay channel. Summarizing the above arguments, 
we obtain the following two corollaries. 

Corollary 1: For the reversely degraded relay channel Y, 

n d in \Y)^Tz d {Y)^n d out) (Y). 

Corollary 2: In the deterministic coding case, if the relay 
channel Y is degraded, then no security on the private mes- 
sages is guaranteed. 

Corollary Q] implies that the suggested strategy in Theorem 
[T] is optimal in the case of reversely degraded relay channels. 
Corollary |2] meets our intuition in the sense that if the 
relay channel is degraded, the relay can do anything that the 
destination can. 
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Next we define another pair of inner and outer bounds. 
Define a set of random triples (U,X, S) G U xX xS by 

V 2 = {(U,X,S) : \U\ < \Z\\X\\S\ +3, 
U ->■ XSZ -^Y} . 

It is obvious that V\ CP 2 - Set 

n { i a \u,x,s\r) 

= {(Ro, Ri,R c ) : Ro, Ri,Re > , 
Ro < mm{I(US; Y),I(U; Z\S)} , 
Ro + Ri < I{X;Y\US) 

+ min{I(U;Z\S),I(US;Y)}, 
R c < [Ri-I(X;Z\US)]+, 
Re < [I(X; Y\US) - I(X; Z\US)}+ .} , 

n { ° ut \u,x,s\r) 

= {(Rq, Ri,R c ) ■ Rq, Ri,R c > , 
Ro < mm{I(US; Y),I{U; Z\S)} , 
Ro + Ri < I(X;Y\US) 

+ mm{I(U; Z\S), I{US; Y)} , 
R c < [Ri - I{X; Z\US) + I(U; Z\XS)}+ , 
Rc < [I(X; Y\US) - I(X; Z\US)]+ .} . 

Furthermore, set 

4 in) (r)= |J K^^X^lT), 

^(out) (r) A y U W( UiX ,S\r). 

(u,x,s)ev 2 

Then, we have the following theorem. 
Theorem 2: For any relay channel T, 

nf ] {T) c ^ in) (r) c ^ d (r) c ^ out) (r) . 

Here we consider a class of relay channels in which Z is 
a function of XS. We call this class of relay channels the 
semi deterministic relay channel. If T is semi deterministic, 
U -> XS -> Z for any {U,X,S) G V 2 - On the other hand, 
we have U ZXS Y for any (U, X, S) G V 2 - From those 
two Markov chains we have U — > XS — > YZ, which implies 
that lZ^ n \r)= 7?.j OUt ' ) (r). Summarizing the above argument 
we have the following. 

Corollary 3: If T belongs to the class of semi deterministic 
relay channels, 

74 out) (r) = 7£d(r) =^ in) (r). 

Finally, we derive the third outer bound of TZd (r) which is 
effective for a certain class of relay channels. We consider the 
case where the relay channel T satisfies 

F(y,z\x,s) = F(y\z,x,s)T(z\x). (5) 

The above condition on V is equivalent to the condition that 
X, S, Z satisfy the Markov chain S — > X — > Z. This condition 
corresponds to a situation where the outputs of the relay 
encoder does not directly affect the communication from the 
sender to the relay. This situation can be regarded as a natural 
communication link in practical relay communication systems. 



In this sense we say that the relay channel T belongs to the 
class of natural communication link or briefly the class NL if 
it satisfies (O. 

For given (U,X,S) <E U xX xS, set 

n ( ° ut \u,x,s\T) 

= {(Rq, Ri,Re) : Ro, Ri,R c > , 
R < min{I(U;Y),I(U; Z\S)} , 
Ro + Ri <I(X;Y\US) 

+ min{I(US; Y),I(U; Z\S) + ((S; Y, Z\U)} , 
Rc < [Ri - I(X;Z\US)}+ , 

R c < [I(X; Y\US) - I(X; Z\US) + C(S; Y, Z\U)}+ .} , 
where we set 

((S; Y, Z\U) = I(XS; Y\U) - I(XS; Z\U) 

-[I{X;Y\US) - I(X;Z\US)} 
= I(S;Y\U)-I(S;Z\U) 
= H(S\ZU) - H(S\YU) . 

The quantity ((S;Y, Z\U) satisfies the following. 
Property 1: For any {U,X, S) G V 2 , 

C(S; Y, Z\U) < min{H(S\Z), I(XS; Y\Z)} . 
Proof: It is obvious that ((S; Y, Z\U) < H(S\Z). We prove 
C(5; Y, Z\U) < I(XS; Y\Z). We have the following chain of 
inequalities: 

C(S; Y, Z\U) = H{S\ZU) - H(S\YU) 

< H(S\ZU) - H{S\YZU) = I(S;Y\ZU) 
= H(Y\ZU) - H(Y\ZUS) 
<H(Y\Z)-H(Y\ZUS) 

< H(Y\Z) - H(Y\ZXSU) 

= H{Y\Z) - H(Y\ZXS) = I(XS;Y\Z), 

where the last equality follows from the Markov condition 
U -> ZXS Y. M 
Set 

^(out )(r) A |j $W( UiX ,s\r). 

(u,x,s)eP! 

Our result is the following. 

Theorem 3: If V belongs to the class NL, we have 

ftd(r) C7^ out) (r). 
It is obvious that if ((S; Y, Z\U) < for (U, X, S) £ Vi, 
we have 

^ in) (r) =n d (r) = n ( ° ut \T). 

By Property [T] the condition that 

mm{H(S\Z),I(XS,Y\Z)} = for any (X, S) (6) 

is a sufficient condition for ((S;Y, Z\U) to be non positive 
on (U, X, S) £ V\. The condition (O on T is very severe. 
We do not have found so for any effective condition on T 
such that C{S;Y,Z\U) < for any [U,X,S) G Vi. When 
\S\ = 1, then by Property Q] we have ((S;Y,Z\U) < 0. 
Hence 7^j OUt ^(r) coincides with TZ^ d \t). In this case, the 
class NL becomes a class of general broadcast channels with 



6 



one output and two input. Thus, the coding strategy achieving 
T^d (-0 m Theorem [2] is optimal in the case of BCC and 
deterministic coding. 

B. Stochastic Encoding Case 

In this subsection we state our results on inner and outer 
bounds of 1Z S (T). Set 

ni in \u,x,s\r) 

= {(R 0} Ri,R c ) ■ < Ro 7 < R c < Ri, 
Ro < mm{I(US; Y),I(U; Z\S)} , 
Rx <I{X;Y\US), 
R c < [I(X; Y\US) - I(X; Z\US)}+} , 

n ( ° ut) (u,x,s\T) 

= {(Ro,Ri,R e ):0<Ro,0<R e <Ri, 
Ro < min{I(US; Y),I(U; Z\S)} , 
#i < I(X;YZ\US), 
Ro + Ri< I(XS;Y), 
R c < I(X;Y\ZUS).}. 

Furthermore, set 

ni in Hv)= [j ni in Hu,x,s\v), 

(u,x,s)eVi 

£(out)( r )A |j n { ° ut) (u,x,s\T). 

We further present another pair of inner and outer bounds 
of 7^ s (r). To this end define sets of random quadruples 

(U,V,X,S) e U xV xX xS by 

Qi = {{U,V,X,S) : \U\ < \X\\S\+3, 
|V| < (\X\\S\f +4\X\\S\+3, 
U -+V -> XS -> YZ, US^V -> X.}, 

Q 2 = {(U,V,X,S):\U\<\Z\\X\\S\+3, 

\V\ < (\Z\\X\\S\) 2 +4\Z\\X\\S\+3 7 
U -> V -> XSZ -^Y,US^ VX -> Z, 
US^V -> X.}. 

It is obvious that Qi C Q 2 . For given (U, V,X,S) E U xV 
xX xS, set 

^(c/,v,x,5|r) 

= {(R ,Ri 7 R c ):0<R 07 0<R c <Ri, 
Ro < mm{I(US; Y), I(U; Z\S)}, 
Ro + Ri < I(V;Y\US) + imn{I(US;Y),I(U; Z\S)}, 
Rc < [I(V; Y\US) - I(V; Z\US)}+.}. 

Furthermore, set 

^ in) (r)= |J n(u,v,x,s\r), 

(u,v,x,S)ea 1 

ni out) (T)= |J n(u,v,x,s\T). 

(U,V,X,S)eQ 2 

Our capacity results in the case of stochastic encoding are as 
follows. 



Theorem 4: For any relay channel T, 

n^ n] (T) c^ s (r) c^(° ut )(r). 

Theorem 5: For any relay channel T, 

^ in) (r) c n^ n) (r) c n s (r) c 7^ out) (r) . 

The above two theorems together with arguments similar to 
those in the case of deterministic coding yield the following 
three corollaries. 

Corollary 4: If the the relay channel V is reversely de- 
graded, 

7^ in) (r) =n a (r) = 7^ out) (r). 

Corollary 5: If the relay channel V is semi deterministic, 

7^ in) (r) =?e s (r) = 7^ out) (r). 

Corollary 6: If the relay channel T is degraded, then no 
security on the private messages is guaranteed even if /„ is a 
stochastic encoder. 

When | S \ = 1, the reversely degraded relay channel 
becomes the degraded broadcast channel. Wyner [4] discussed 
the wire-tap channel in the case of degraded broadcast chan- 
nels. Corollary |4] can be regarded as an extension of his result 
to the case where wire-tapper may assist the transmission of 
common messages. Corollary [6]meets our intuition in the sense 
that if the relay channel is degraded, the relay can do anything 
that the destination can. 



C. Stochastic Relay Function 

In this subsection we state our results in the case where the 
relay may use a stochastic encoder. Let lZ* d (T) and 7?.* (T) be 
denoted by the deterministic and stochastic rate equivocation 
regions, respectively, in the case where the stochastic relay 
encoder may be used. It is obvious that ft d in) (r) and ft d in) (r) 
still serve as inner bounds of K* d (T). Similarly, 7?i in) (r) and 
serve as inner bounds of 1Z* (T). Our capacity results 
on outer bounds in the case of stochastic relay encoder are 
described in the following theorem. 

Theorem 6: If T belongs to the class NL, 7^ d ° ut) (r), 
1Z d ° (T), and 7?. d out ^(r) still serve as outer bounds of 
Tl* d (T). Similarly, if T belongs to the class NL, 7?i out) (r) 
and 7?i° ut (T) still serve as outer bounds of 7?.* (T). 



IV. Secrecy Capacities of the RCC 

In this section we derive explicit inner and outer bounds of 
the secrecy capacity region by using the results in the previous 
section. We first consider the special case of no common 
message. Define 

ftdie(r) = {(Ri,R c ) : (0, Rt, R e ) E TZ d (T)} , 

n,u(T) = {(Ri,ite) ■ (o,iii J iz e )efl B (r)}. 
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To state a result on 7£die(r) an d T^sic(r) set 
n^l(U,X,S\T) = {(R x ,R e ) : R x ,R e > 0, 



Tt^^X^lr) = {(iJi.iZe) : R x ,R e > 0, 

i?i < /(x ; rz|[/s*), 

i?c< [i?i-/(X;Z|[/S)]+.}, 

^(^X^lr) = {(R x ,R e ) :R x ,R e >0, 
R c <Ri< I{X;Y\US) 7 
R c < [I(X;Y\US) 

-I(X;Z\US)]+.}, 

Ki°f (U, X, S\T) = {(R x , R c ) : R x , R c > , 

R c <Ri< I(X;YZ\US), 
R c < I(X;Y\ZUS) .} , 

± (J n$>(u,x,s\r), 

A y £(out) 
(c/,x,s)e-Pi 

A I I ^(in) 



A 



*22(r) 



7? 



(out) . 



die (r) 
«(r) 



dlc (c/,x,5|r), 



(J 7^(t/,x,s|r), 

(c/,x,s)e-Pi 



(U,X,S)GV! 

From Theorems Q] and |4] we have the following corollary. 
Corollary 7: For any relay channel T, 

^'(nc^fricKir'tr). 

In particular, if V is reversely degraded, 

ii^(T)=Ti dXe (r) = n^\r), 
7t^ ) (r) = 7^ slc (r) = ^° c ut) (r). 

Now we consider the case where V is reversely degraded. 
In this case we compare (T) = 7^dic(r) and itj^fi) = 
TZ slc (T). The regions 1Z^J(U,X,S\T) and K^(U,X,S\T) 
in this case are shown in Fig. [3] It can be seen from this 
figure that the region "R^l(U, ^ s strictly smaller than 

H^(U,X,S\T). In H^(U,X,S\T), the point (R{,R* e ) 
whose components are given by 

Rl=R*=I(X;Y\US)-I(X;Z\US) (7) 

belongs to 7?. s i e (r). This implies that the relay is kept com- 
pletely ignorant of the private message. In this case we say 
that the perfect secrecy on the private message is established. 
The stochastic secrecy capacity region C ss (r) and the secrecy 
capacity C ss (r) for the RCC are defined by 

C SS (T) = {(Ro, R x ) : (i? , Ri,Ri) € Tl s {T)} , 

A 



C SS (T) 



max i?i 

(fli,i?i)G7e B i„(r) 



max i?i 

(0,Ki)GC as (r) 



(R x ,R e ) e fcdle(r). Then, it follows from Corollary [7J that 
if r is reversely degraded, we must have 



I{X,Z\US) = for (U,X,Y) e V x . 



(8) 



On the other hand, if we require the perfect secrecy in the 
case of deterministic encoding, we must have R x = R c for 



This condition is very hard to hold in general. Thus the prefect 
secrecy on private message can seldom be attained by the 
deterministic encoding. Another criterion of comparing 7^d(r) 
and 1Z S (T) is the maximum equivocation rate in the rate- 
equivocation region. For 7Z d (T) and TZ S (T), those are formally 
defined by 

Cde(r) = max R c and C se (r) = max i? , 

(R ,Ri,Re) (R ,Ri,R e ) 

eRd(r) eK,(r) 

respectively. We describe our results on C ss (r), Cd e (r), 
C ss (r), and C sc (r) which are obtained as corollaries of 
Theorems Q] and |4] Set 

C~£ n) ( r )= {(Ro,Ri):R o ,Ri>0, 

Ro < min{I(US; Y),I(U; Z\S)} , 
Ri < [I(X; Y\US) - I(X; Z\US)}+ , 
for some (U,X,S) 6 Pi .} , 

Cl out >(r)= {(R o> R x ):R ,R x >0, 

Ro < min{I(US; Y),I(U; Z\S)} , 
Ri < I(X;Y\ZUS) , 
for some (U,X,S) € V x •} • 

Then we have the following. 

Corollary 8: For any relay channel V, 

cl n )(r)cc ss (r)ccir)(r). 

Furthermore, we have 

jn^[I(X;Y\S)-I(X;Z\S)] + 

< max \I(X;Y\US) - I(X;Z\US)} + 

(u,x,s)evi 

< C dc (T) < C SS (T) < C SC (T) 

max I(X: Y\ZUS) = max I(X; Y\ZS) . 

(u,x,S)eVi (x,S) 

In particular, if T is reversely degraded, we have 
and 

c dc (r) = c ss (r) = c sc (r) 

= me f [I(X;Y\S)-I(X;Z\S)} . 

(X,b) 

Typical shapes of the regions 7?.die(r) and 7?. s i c (r) in the 
case of reversely degraded relay channels are shown in Fig. |4] 
The secrecy capacity C ss (r) is also shown in this figure. Next, 
we state a result which is obtained as a corollary of Theorems 
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,., .(in) 

□ R d i c (u,x,s\n 




h-h h /i 
/, = / (X; Y I US) , I 2 = I(X; Zl US) 



Fig. 3. The regions (U, X, S\T) and K^J (U, X, S\T) 



$(in)/ 



Css(D 




Css(D 



Fig. 4. The regions TZ dle (r) = K^T) and 1Z Blc (T) = Tl^J (T) and 
Cas(r) = Cdc(r) = Csc(r) for the reversely degraded relay channels. 



|2] and [5] To state this result, set 



K<&>(u,x,s\r) 

= K d in) (U, X, S\T) n {(R , R u R e ) : R = 0} 

= {(Rl,Re) '■ Rl,Re > Oj 

-Ri < J(X ; y|C/5) + vam{I(US;Y),I(U;Z\S)} , 

Re < [Ri-I(X;Z\US)]+, 

R c < [I(X; Y\US) - I(X- Z\US)]+ .}, 

n d °^\u,x,s\v) 

= TZ { ° ut) (U, X, S\T) n {(Ro, Ri,R e ) : R = 0} 

= {(Ri,Re) :R 1 ,R e >0, 

Ri < I(X;Y\US) +mia{I(U; Z\S),I(US;Y)} , 
Re < [Ri - I(X; Z\US) + I(U; Z\XS)}+ , 
R c < [I(X; Y\US) - I(X; Z\US)}+ .}, 

n le (u,v,x,s\r) 

= TZ(U,V,X,S\T)n{(R ,Ri,R e ) : Ro = 0} 

= {(Ri,Re):0<Re<Ri, 

Ri < I(V; Y\US) + min{I(US; Y), I(U; Z\S)} , 
Re < [I(V; Y\US) - I(V; Z\US)]+ .}, 

»S2(T)= (J K$l(U,X,S\T), 

(!7,X,S)eQi 

< u c t} (r)= U ^(^x.sir), 

(U,X,S)EQ 2 

^ic } (r)= (J ^ie(^^x,s|r), 

(c/,v,x,s)eQi 

^ c ut) (r)= (J Hie(u,v,x,s\T). 

(u,v,x,s)eQ 2 



Furthermore, set 

C S (U,V,X,S\T) 

= n(U,V,X,S\T)n{(Ro,Ri,R c ) :Ri=Re} 

= {(Ro, Ri) : Ro, Ri > , 

i?o < min{I(US; Y),I(U; Z\S)} , 
Ri < [I(V;Y\US)-I(V;Z\US)]+}, 

C£°(T) = (J C B (U,V,X,S\T), 
(u,v,x,s)eQi 

ci out) (r)= |J c s (u,v,x,s\T). 

From Theorems [2] and [5] we have the following corollary. 
Corollary 9: For any relay channel V, 

K$l(r) c 7e dlc (r) c rc<£°(r) c ^° c ut) (r) , 
rc£ii( r ) <= rc& } (D c ft sle (r) c ^ ut) (r) , 
c s ^(r)cc ss (r)cc s (° ut) (r). 

Furthermore, 

max \I(X;Y\US) - I(X; Z\US)] + 
{u,x,s)eVi 

< C dc (T) 

< max \I(V;Y\US) - I(V;Z\US)] + , 

{U,X,S)&V 2 

max \I(V;Y\US) - I(V;Z\US)] + 

(u,v,x,s)eQi 

< c ss (r) < c sc (r) 

< max \I(V;Y\US) - I(V;Z\US)] + . 
~ (u,v,x,s)eQ 2 

If r is semi deterministic, then 

^dTe ) (r) = ^dic(r) = ^° 1 u c t) (r), 

^l n e ) (r) = 7e slo (r) = ^° c ut) (r), 
cir)(r)=c ss (r)=ci s out) (r). 



max \I(X; Y\US) - I(X; Z\US)] + , 
(u,x,s)evi 



Furthermore, 

C dc (T) = 

C SS (T) = C SC (T) 

max \I(V;Y\US) - IlV; Z\U S)] + . 

{U,V,X,S)£Q! 

It can be seen from the above corollary that C sc (r) may 
strictly be larger than Cd e (r) unless T is reversely degraded. 
By a simple analytical argument we can show that cis n '(r) 
can be attained by S = s*, where s* G S is the best input 
alphabet which maximizes the secrecy rate 

max {I(V; Y\US = s*) - I(V; Z\US = s*)} . 
(v,u,x,s=s")eQi 

This implies that the coding strategy achieving cis"' (r) does 
not help improving the secrecy rate compared with the case 
where the relay is simply a wire-tapper, except that the relay 
may choose the best S = s* to benefit the receiver. Cover 
and El Gamal [24] introduced a transmission scheme of the 
relay called the compress-and-forward scheme, where the relay 
transmits a quantized version of its received signal. This 



scheme is also applicable to the RCC. He and Yener [18], 
[19] derived an inner bound of P s i (T) in the case where the 
relay employs the compress-and-forward scheme to show that 
the relay may improve the secrecy capacity. 



V. Gaussian Relay Channels with Confidential 
Messages 

In this section we study Gaussian relay channels with con- 
fidential messages, where two channel outputs are corrupted 
by additive white Gaussian noises. Let (£i,£ 2 ) be correlated 
zero mean Gaussian random vector with covariance matrix 



pVWn^ n 2 



>I<1. 



Let {(£i,i,£2,i)}™i be a sequence of independent identically 
distributed (i.i.d.) zero mean Gaussian random vectors. Each 
(£i,i,£2,i) has the covariance matrix S. The Gaussian relay 
channel is specified by the above covariance matrix S. Two 
channel outputs Yi and Zi of the relay channel at the ith 
transmission are given by 

Y = Xi + Si + £i t i , Zi = Xi + £2,1 ■ 



our results on 7£ d (Pi,P 2 |E) and 1l s (P 1 , P 2 \Yl), set 



^ in) (P 1 ,P 2 |E) 



A 



= {(Ro, Ri, Rc) ■ Ro,Ri,Rc > 0. 



Ro < max min < C 

0<))<1 [ 

C 



SP 1 +P 2 +2y/SfjP 1 P 2 



ePt+Nt 



( §r l P 1 \\ 
\8P 1 +N 2 J ] 



Rc < 



Ri-C{^ 



for some < 6 < 1 .} , 



4 out) (A,p 2 |s) 



= {{Ro, Ri,R c ) ■ Ro, Ri, Rc > . 



R < min ) r ( SPl+P2+2y/Sf]P 1 P 2 

Ho < mm <( C [ ei\+Nl 



r ( SyPi \ \ 
° \6P!+N 2 J J ' 



Ri < C 



8P1 



(l-p' 2 )N 1 N 2 
N 1 -t-N 2 - 2 py/NiN 2 



R + Rl <C[ p ^+lf^ 



Rc < 



for some < 9 < 1, < 77 < 1 .} , 



where C(x) = | log(l + x) . Furthermore, set 

^(Pi,P 2 |E) 



It is obvious that S belongs to the class NL. In this class 
of Gaussian relay channels we assume that the relay encoder 
{gi}i=i is allowed to be stochastic. Since (£1 », £ 2 ,i)> i = 
1, 2, • • • , n have the covariance matrix S, we have 



[N2 
V ivi 



where £211,11 i = L 2, • • • , n are zero mean Gaussian random 
variable with variance (1 — p 2 )N 2 and independent of £1^. In 

particular if £ satisfies N\ < N 2 and p = J j^, we have for 
z = 1,2, ■ • ■ , n, 



Yi — Xi + Si + Zi — Xi + £i t i + £ 



2|l,i 



which implies that for i = 1,2, • • ■ , n, Zi — > (}i,Si) — ^ 
Hence, the Gaussian relay channel becomes reversely 
degraded relay channel. Two channel input sequences {Xi}™ =1 
and {Si}^ =1 are subject to the following average power 
constraints: 

-. n 1 n 



Let 1Z&(P\, P 2 |£) and 1Z a {P\, P 2 \E) be rate-equivocation 
regions for the above Gaussian relay channel when we use 
deterministic and stochastic encoders, respectively. To state 



{(Ro,R\,R c ) : Rq,Ri,R c > 0, 



Pn < max min 

0<i;<l 



(j ( §P 1 +P 2 +2^/eriP 1 P 2 



ePi+N ± 



Re < Rl < C (^) , 



Rc < 



A 



for some < 6 < 1 .} , 

^ out )(P 1 ,P 2 |E) 

{(Po,Pi,P c ) : Ro,Ri,R c > 0, 
Po < mm <j G I eH+wI 



Po + Pi < C 



R c <Ri<C 



Pi+P 2 +2y/er l P 1 P 2 
iVi 

9Pi 

(l-p , -')N 1 N 2 



N 1 + N 2 -2p v / N1JV2 



Pc < 



(l-p2 )jVlJ v 2 



\ iV 1 + iV 2 -2p v /iV 1 JV 2 / 

for some < < 1, < r) < 1 .} . 



Our results are the followings. 
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Theorem 7: For any Gaussian relay channel E, 

Tl1 n \P 1 ,P 2 \T l ) C ft d (Pi,P 2 |E) C ft d ° ut) (Pi,P 2 |E), (9) 
7^ in) (Pi,P 2 |£) Cft s (Pi,P 2 |E) c^ out) (Pi,P 2 |S). (10) 

In particular, if the relay channel is reversely degraded, i.e., 
iVi < N 2 and p = J~^f, then 



ft d in) (Pi,P 2 |S) = 7e d (Pi,P 2 |S) = ^ d ouc j (Pi , P 2 |E) , 

^ in )(P 1; P 2 |E) =72 B (P 1 ,P 2 |S) =^ out )(P 1 ,P 2 |S). 

Proof of the first inclusions in (0 and ( fTOb in the above 
theorem is standard. The second inclusions in (0 and (TlOb 
can be proved by a converse coding argument similar to the 
one developed by Liang and Veeravalli [27]. Proof of Theorem 
|7] will be stated in Section VIII. 

Next we study the secrecy capacity of the Gaussian RCCs. 
Define two regions by 



(out) , 



A 



ft d l e (Pi,P 2 |£) 

{(Ri,R e ) : (0,R 1 ,R e )e1Z d (P 1 ,P 2 \T,)} 
7e s ie(Pi,P 2 |S) 



A 



= {(Pi,P c ) : (0,P l5 Pe) € ft 8 (Pl,P 2 |E)} . 

Furthermore, define the secrecy capacity region C ss (Pi, P 2 |E) 
and the secrecy capacity C ss (Pi,P 2 |E) by 



A 



A 



C SS (P,P 2 |E) 

{(P ,Pi) : (P ,Pi,Pi) G^ s (Pi,P 2 |S)} . 
<7 ss (Pi,P 2 |E) 

max Ri= max Pi 

(fli,fli)e??. s i.(Pi,P2|s) (o,Pi)ec S s(Pi,P2|£) 



Maximum equivocation rates for "P d (Pi, P 2 |E) and lZ s (Pi, 
P 2 |E) are defined by 



A 



C de (Pi,P 2 |S) = max R e , 

(R ,R 1 ,R c )£K d (P 1 ,P 2 \X) 



A 



Set 



C se (Pi,P 2 |E) = max P c . 

(Po,Pi,P„)e7?. s (Pi,P2|£) 



K l £>(Pi\E) = {(Pi,P e ) : Pi,P c > 0, 



K 



(out) , 



A 



for some < 6 < 1 .} , 
dlc (Pi|E)= {(Pi,P e ) :Pi,P e >0, 

Ri<C 



ePi 



(l~ p ^)N 1 N 2 



Ro < 



\ N 1 + N 2 -2p v /]V 1 ]V 2 
«1 - C [ft 

for some < 6 < 1 .} , 



^(PilS) = {(Pi,Pe) : Pi,Pe > ; 

Pc < Pi < C (ft 



Rr < 



A 



rc&Vils) 

{(Pi,P c ) :Ri,R e > 0, 
R c <Ri<C a 



(i^p 2 )ivi«7 



Ni + ]Y 2 --2p v /JV 1 JV2 



Rr < 



C 



(1~ P 2)W 1 W 2 
W 1 + W 2 -2p v /JV 1 JV2 



c 



(ft) 



Furthermore, set 

C s ^)(Pi,P 2 |S) 



A 



{(Po, Pi) : Po, Pi > . 



Pn < max min < C 



0<?j<1 



flPi+P2+2yeijPiP2 



ePi+A^i 



C 



\8P 1 +N 2 J I 



Pi < 



A 



for some < 9 < 1 .} , 

C^(P 1 ,P 2 \E) 
{(P ,Pi) :Po,Pi >0, 



Pn < max min < C 

0<r/<l 



ep 1 +p 2 +2^8f 1 p 1 p 2 
ePi+Nt 



r f-infi—M 



Pi < 



8Pi 



(l-pJ)N 1 N 2 



\ Ni+N 2 -2py/NiN 2 / 

for some < 9 < 1 .} 



C ( ^ 



We obtain the following two results as a corollary of Theorem 

m 

Corollary 10: For any Gaussian relay channel E, 

C P d ic(Pi,P 2 |S) C ^(PIE) , 



^(PilE) C P slc (Pi,P 2 |S) C K^iP^) . 

In particular, if N\ < N 2 and p = J j±, the regions Pdic(Pi, 
P 2 |E) and P s i (Pi, P 2 |E) do not depend on P 2 and 

P^PIE) = P dlc (Pi|E) = fc&VilE) , 

P^(Pi|S) =7e sle (Pi|E) =^ t) (Pi|S). 
Corollary 11: For any Gaussian relay channel E, 

c£ n > (P , P 2 1 S) C C ss (Pi , P 2 |E) C Ci out) (Pi , P 2 1 E) . 

Furthermore, 

+ 



(out) , 



< C dc (Pi,P 2 |E) < C ss (Pi,P 2 |E) < C se (Pi,P 2 |E) 

+ 

c 



< 



Pi 

(l-p2) wl ~ 



iV 1 + iV 2 -2p v /iV 1 7V2 



In particular, if iV x < 7V 2 and p = ^/^, 

C£ n ) (P , P 2 1 E) = C ss (P , P 2 1 E) = C£° ut) (Pi, Pi | S) 
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Re lR dle (Pi|£) 




Fig. 5. Shapes of Ti^i c (Pi |S) and 1Z b i c (Pi |E) for the reversely degraded 
relay channel E. 

and 

C dc (P , P 2 1 E) = C ss (Pj , P 2 1 E) - C sc (P , P 2 1 E) 

= c(£)-c(fc). 

Typical shapes of 7^die(-Pi|S) and 7t s i G (Pi|E) for the 
reversely degraded relay channel E are shown in Fig. [5] 
Note that the secrecy capacity C ss (Pi, P2IE) for the reversely 
degraded relay channel does not depend on the power con- 
straint P2 at the relay. This implies that the security of private 
messages is not affected by the relay. Leung-Yan-Cheong and 
Hellman [29] determined the secrecy capacity for the Gaussian 
wire-tap channel. The above secrecy capacity is equal to the 
secrecy capacity of the Gaussian wire-tap channel derived by 
them. 

VI. Derivations of the Inner Bounds 

In this section we prove Theorem Q] and the inclusion 
7^ in) (T) C K S (T) in Theorem 

A. Encoding and Decoding Scheme 

We first state an important lemma to derive inner bounds. 
To describe this lemma, we need some preparations. Let T n , 
J n , and C n be three message sets to be transmitted by the 
sender. Let T n ,J n , and L n be uniformly distributed random 
variable on Tn, Jn, and £„, respectively. Elements of T n 
are directed to the receiver and relay. Encoder function /„ 
is a one to one mapping from T n X J n X C n to X n . Using 
the decoder function ip n , the receiver outputs an element of 
T n X JnX C-n from a received message of y n . Using the 
decoder function cp n , the relay outputs an element of T n from 
a received message of Z n . Formal definitions of t/j n and cp n are 
i>n '■ y n — > T n x Jn x &n , fn '■ Z n — > T n ■ Error probabilities 
of decoding at the receiver and the relay are defined by 

n[ n) = Pr{V„(r") ^ (T n ,J n ,L n )} and 

/4 n) ^ PrWn(Z n ) + T n }, 

respectively. The following is a key result to derive inner 
bounds of K d (T) and K S (T). 

Lemma 1: Choose (U, X, S) G Vi such that I(X; Y \US) 
> I(X; Z\US). Then, there exists a sequence of quadruples 



{(/«, i> n ,<Pn)}n=l such mat 

lim fjL^ = lim ^2 = 1 

n— >oo n— >oo 

lim -log\T n \ = min{I(US;Y),I(U; Z\S)} , 

n— foo XI 

lim -log|J n | = 7(X;F|[/5), 

n— >-oo 77, 

lim -log|£„| =I(X;Y\US)-I(X;Z\US), 

n—toc fl 

lim -H(L n \Z n ) > I(X; Y\US) - I(X; Z\US) . 

n—>oo TL 

In this subsection we give an encoding and decoding 
scheme which attains the transmission and equivocation rates 
described in Lemma Q] Let 

7; = {1,2,...,2L"^J}, £„ = {1,2,--- J 2^J}, 
J n ={l,2,---,2^}, 

where [^J stands for the integer part of x for x > 0. We 
consider a transmission over B blocks, each with length n. For 
each i = 1, 2, • • • , B, let (U,ji, U) e 7J,x Jn'x £>n be a triple 
of messages to be transmitted at the ith block. A sequence 
of B — 1 message triples (ti,ji, k), i = 1, 2, • • • , B — 1 are 
sent over the channel in nB transmission. For i = 0, the 
constant message pair (to, jo, Iq) = (1, 1, 1) is transmitted. For 
fixed n, the rate triple (Rq £=1 } ri M=L i r2 IL-L ) approaches 
(R , ri, r 2 ) as B — > 00. 

We use random codes for the proof. Fix a joint probability 
distribution of (U, S, X, Y, Z): 

PusxYz(u,s,x,y,z) 
= Ps{s)pu\si u \s)Px\us(x\u, s)T(y, z\x, s) , 

where U is an auxiliary random variable that stands for the 
information being carried by the message to be sent to the 
receiver and the relay. 

Random Codebook Generation: We generate a random 
code book by the following steps. 

1. Set W n = {1,2, 2L n, 'J}. Generate 2^ i.i.d. s e 
S n each with distribution Yl7=i Ps(si)- Index s(w),w G 

2. For each s(w), generate 2^ nR °^ i.i.d. u G U n each with 
distribution Yl7=i Pu(ui\Si). Index u(w,t), t E T n - 

3. For each s(w) and u(w,t), generate 2L ,lri J -2L™ r2 J i.i.d. 
x E X n each with distribution n™=i Px\us( x i \ u i,Si). 
Index x(w,t,j,l), (w,t,j,l) e W„ xT n xJ n xC n - 

Random Partition of T n - We define the mapping <f> n : T n 
—> W n in the following manner. For each t € Tn, choose 
w E W n at random according to the uniform distribution on 
W n and map t to w. The random choice is independent for 

each t G T n - For each w G W n , define T n (w) = {t G T n ■ 
4>n(t) = w} . The family of sets {T n (w)} w( zyv n is a partition 

Of Tn ■ 

Encoding: Let (ti,ji,li) be the new message triple to be 
sent from the sender in block i and (4j_x,j'j_i, ?i_i) be the 
message triple to be sent from the sender in previous block 
i — 1. At the beginning of block i, the sender computes u> j = 

<t>n{U-i) and sends the codeword x(wi,U,ji,li) G X n . 
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At the beginning of block i, the relay has decoded the 
message U-i- It then computes wi = 4> n {U-i) an d sends 
the codeword s(wi) G S" . 

Decoding: Let y i G y n and Zi G Z n be the sequences 
that the reviver and the relay obtain at the end of block i, 
respectively. The decoding procedures at the end of block i 
are as follows. 

1. Decoder 2 at the Relay: Define 

, I s A . PUZ\S(U,Z\S) 

iuz\s{u:z\s) = log- 



' Pu\s{u\s)pz\s(z\s) 



A 



A uz \s,e = {(s,u,z)eS n xU" x Z n : 
±i uzls (u;z\s) > R + e} . 

The relay declares that the message U is sent if there is a 
unique U such that 

(s(Wi),u(Wi,ii),Zi) G A UZ \S,e- 

It will be shown that the decoding error in this step is small 
for sufficiently large n if R < I(U; Z\S) . 

2. Decoders la and lb at the Receiver: Define 

isY{s;y) = log- 



Ps(s)py(v) 



% UY\S 



, I n a . p UYls (u,y\s) 

(w; y\s) = log r — — 

Pc/|s(w|s)Py|s(y|s) 



A 



-Asr.e = {(s,y)eS n xy n : 

ilogi sy (s;y) > r + e} , 

^£/K|S, e = {(s,u,y)eS n xU n xy n : 

±iuY\s(u; y\a) +r> R + e}. 

The receiver first declares that the message Wi is sent if there 
is a unique Wi such that (s(wi), yj € Asy,h ■ It will be shown 
that the decoding error in this step is small for sufficiently large 
n if r < I(Y; S) . Next, the receiver, having known Wi-i and 
Wi, declares that the message U-i is sent if there is a unique 
such that 



[siWi-^tUiwi-i^i-i)^^) G A UY \S,e 

and eT n (wi)- 

It will be shown that the decoding error in this step is small 
for sufficiently large n if 

i?o <I(U;Y\S) + r 

< I{U; Y\S) + I(Y; S) = I{US; Y) . 

3. Decoder lc at the Receiver: Define 

PXY\Us( x ,V\ u , s ) 



A 



ixY\us{x;y\u, s) = log 



PX\US(X\U, s)p Y \us(y\ u , S) ' 



A 



A X Y\us,e = {(s,u,x,y) G S n x U n x X n x y n : 
£ ixY\us(v, y\u, s) > n + r 2 + e} . 

The receiver, having known declares that the 

message pair (ji-i,h-i) is sent if there is a unique pair 



(w-i,ti-i,ji-i,h-i) 
i i 

u{Wi-l,ti-l) 

i i 



(Wi,ti,ji,li) 

I 
I 



x(yvi-i,ti-i,ji-i,lj-i) \ x(w h ti,ji,li) 



h-i- 



wi 



(Wi+l,U+l,ji+l,li+l) 

- s(w i+1 ) 

I I 

u(w i+1 ,t i+1 ) 
I I 

, x(Wj+l.ti+l,ji+l,li+l) 



□ 



ti+1 - 



Zi-l , Zi 

JkLsnM. 



\Z22ZZ^22ZZZ2222i 



z i+l ,0. , 



XZZZZZZZZZZZSZZZi 



j — *-\ Dec. la}j 



► |Pcc.lbh p-f,. 2 
► |Dec.lc| -»-U-2,/)-2) 



vzzzzzzzzzzzzzzzm 
'La 



mzzzzzzzzzzzzzm 

yi+i * 



mr 1 



'eclbh *?,-; 



Dec.lc| ->(j-j,/,w) 



Dec.la 



Dcc.lbh ->f; 

DeclcK Q,/,) 



Fig. 6. Encoding and decoding processes at the blocks i — 1, i, and i + 1. 

such that 

^a(iOi_i), x^i-i^i-i, ii-i), Z/i-i 

It will be shown that the decoding error in this step is small 
for sufficiently large n if ri + r 2 < I(X; Y\US) . 

For convenience we show the encoding and decoding pro- 
cesses at the blocks i — 1, i„ and i + 1 in Fig. [6] 

fi. Computation of Error Probability and Equivocation Rate 

In this subsection we compute error probabilities of de- 
coding and equivocation rate for the encoding and decoding 
scheme stated in the previous subsection. We will declare an 
error in block i if one or more of the following events occurs. 

82,1- Decoder 2 fails. Let £2,1 = £2,1 U £2,%, where 
£2,1- (s(wi), u(wi,U),Zi) <£ Auz\S,e< 
£ 2 y. 3 ii ^ U such that (s(wi), u(w t ,i t ), z t ) e 
Auz\s,e ■ 

£i a ,i- Decoder la fails. Let £\ a .i = £\ a .i U £i a .i, where 

£\ a ,i- (s(wi),y t ) <£ A S Y,e, 

£ la>i : 3 w t ytw t such that (s(wi), y t ) E A S v,e ■ 
£ib.i- Decoder lb fails. Let £%h,i = £ib,i U £ib,i> where 
£ib,i: (s(wi-i), m(w ? „i,^;_i), y^) £ AuY\s,e> 
£ib,f-3 ii-i ^ U-i such that (s(w i - 1 ), u(wi, U-i), 

Vi-l) G A UY \S,e, U-l €T n {Wi). 

£i c y. Decoder lc fails. Let £\ c ^ = £ic,i U £\ c ,i, where 

£ lc>i : (s(wi-i), u(wi-!, U-i), Xi-i(wi-i, U-i, 

ji-i, h-i), Vi-i) £ A X Y\us,u 
£i C)i :3 (ji_i,f,_i) ^ (ji-i,k-i) such that (s( 

Wi-i), u(Wi-i, U-i), Xi-i(Wi-i, U-i, ji-l, 
k-l), Vi-l) € A X Y\US,e ■ 

For each i = 1, 2, • • • , B, let (T n ^, J nji , L n ,i) G T n x J n x 
C n be a message triple to be transmitted at the block i. We 
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assume that (T„.i, J„.i, L ni i), i = 1, 2, • ■ ■ , B are i.i.d. random 
triples uniformly distributed on T n x >Jn x£„. For i = 0, T n j o, 
J n> o and L„ o are constant. For i = 1, 2, • • ■ , B — 1, define the 
random variable W n .i on W„ by W n ,i = 4>n{T n .i-i)- Define 
the error events Ti for decoding errors in block i by 

Fi- W„,i ^ W n ,i or f„,i ^ T„^ or f n>i _ x ^ T njl _i or 

— 1 ) — l) 7^ \^n,i— lj -^n,i — l)- 



It is obvious that J 7 ; C £ 2i U£i a .iU£ib,iU£i c .i . Define e 2 ' 



(n) A 



Pr {^2,-tl-^Li} ■ Definitions of e^, i5 and e-j^ are the 

(n) 

same as that of e 2 / . We further define sets and quantities 
necessary for computation of the equivocation rate. Define 

, 1 \ A . PXZ\US(X,Z\U,S) 

ixz\us{x\z\u,s) = log- 



' Px\us{x\u,s)p z \ us (z\u, s) ' 



A 



Axz\us,e = {(«, u, x, y) G 5" xU n x X n x Z n : 
&xz\us( x '> z \ u ' s)>r 2 + e}. 

For given w% = j/> n (*t-i) € W„, (*,-,/,) G T n xL n and channel 
output Zj of s(wi) and x{wi,ti, ji,h), define the estimation 
function r„ : W„ x7"„ x£„ xZ" -4 J„ by T n (w t ,U,k, Zi) 
= ji if there is a unique pair (j'j, ij) such that 



(s(wi),u(wi,ti),x(wi,ti,jhk),Zi) G -4 



Define e f J = Pv {r n {W n>i ,T nA , L nii , Z n ) ^ J n>i \ . Let 
£i. (s(wi- 1 ), u(wi-i, U-i), &i-i(wi-i, ii-i, 

Zj-l) ^ A X Z\US,t> 

3 7^ such that (s( 

ti-l), Xi-x(Wi-l, ti-\, ji-i, k-l), G 
■AxZ\US^e ■ 

Set £, = £iU £i. Then we have 



» 



= Pr{£} < Pr{fi} + Pr{£} 



It will be shown that the error probability of estimation 
is small for sufficiently large n if r 2 < /(X; Z|J75) . Set 

«Z|A's(zK S) = - l0gp Z | XS (2|x, S), 

iz\us(z\u, s) = - logp z \us(z\u, s), 

B z]XStt = {(s,x,z)g«S"x X n xZ n : 
1 



n 



iz\xs{z\x,s)>H(Z\XS)-e 



B 



Z\US,i 



(s,u,z) G S n xU n x Z n : 
U z]us (z\u,s)<H(Z\US) + e} 
e z\xs,i = Pr{s(W n!i ),x(W nti ,T nti ,L nii ),Z?) 



&Z\XS,e} ' 



e %s,i = Pr{(s(W nti ),u(T nti ), Z?) i B zlus J . 

The operation E e^J stands for the expectation of e 2 n } based 
on the randomness of code construction. Then, we have the 
following lemma. 



Lemma 2: For each i = 1, 2, • • ■ , B — 1, we have 



» 



» 

'la,i 

» 
'lb,i 

» 



» 



-Z\XS,i 
» 

'Z|[/S\i 



<Pr{(S»,[P*,Z»)£ A,z|s,J + 2 ~" e 

< Pr{ (5",y n ) ^^ S y,e} + 2- ne 

< Pr{(S", U n , Y n ) i A UY \ S J + 2 • 2-" e 

< Pr{(S", U n , X n , Y n ) i A XYlsu J + 2" 

< Pr{(5 n , Z n ) ^ ^z|sc/,e} + 2- 
= Px{(S n ,X n ,Z n )^B zl xs,e} 



PT{(S n ,U n ,Z n )$B zluSi£ }. 
Proof of this lemma is given in Appendix A. 
Next, we state a key lemma useful for the computation of the 
equivocation rate. Set = (L n x , L n , 2 , ■ • • , L n j) . Then, 
the equivocation rate over B blocks is 

-Lh(l^\z- b ) >^£\ H {L n M- l) z nB ). 



B n 

i=i 



For each i = 1,2, ■ ■ ■ , B — 1, we estimate a lower bound 

of H(L n j\ Ln ^ Z nB ). Set Z^_^ +1 = 

Z„i) . On a lower bound of H{L n> i\Ln Z nB ), we have the 
following lemma. 

Lemma 3: For i = 1, 2, ■ ■ ■ , B — 1, we have 



-H{L n ,\Lt 1] Z nB ) 



>n+r 2 - I(X:Z\US) - 2e 
-rae^- (log |2|) 



3 + log e 



„(«) , „(«) 

c Z|(7S,i T C Z\XS,; 



(ID 



Proof of this lemma is given in Appendix B. 
Proof of Lemma Q} S et 

7max(e) 

= max{ Pr{(5", U n , Z n ) f A uz \ s , t } + 2"^ , 
Pr{(S n ,Y n ) <£A SY ,e} + 2- ne , 
Pr{(S n , U n , Y n ) i A UYls , e } + 2-™ e , 
Pr{(S n , U n , X n , Y n ) i A XY \su,e} + 2" 
Pr{(S n ,U n ,X n ,Z n ) £ Axz\su,e} + r 
Pv{(S n ,X n ,Z n )£B zlxs , e }, 
Pi-{(S n ,U n ,Z n )£B zlus J}. 

Then, by Lemma |2] we obtain 



B-l 



(™) i „(") i „("•) 



,(») ,. e («) 



B-l 



,(n) 



>) 



= (n) 



+E 



» 

'Z\XS,i 



,(n) 



< 7(B - l) 7 max(e) 
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from which it follows that there exist at least one deterministic 
code such that 

B-l 



Rc 



(n) (n) (ri) (n) . (n) 

e 2,i ' e la,i ' e lb,i e lc,i ' e i 



+4?xs,« + e WS,i} < UB l)7il(e) • (12) 
From 1121 . we have 



B-l 

(nB) _ \- f (n) (») 
Ml — / ^ 1 e la,i + e lb 



(») \ 
lc,i J 



i=i 

<7(B-l) 7 £l(e), 
-Eeg<7(5-l) 7 W(e), 



/'2 

B-l 



5><">< 7(B-l) 7 ^c(e) 



(13) 
(14) 

(15) 



B-l 



> 1 



3 + log e 



(17) 



E + e §U} ^ 7 ( B - ■ (16) 

4=1 

From Lemma |2 fTBt . and (1161 1. we have 

-Lh(l^\z« b ) 

* ^eV (l - |l «" 1)z " B) 

2=1 

ri +r 2 - I(X;Z\US) - 2e 

-7(l-£) [r 2 + (log|Z|)] 7 ^ x ( e ). 

By the weak law of large numbers, when n oo, we have 

±i uzls (U n ;Z n \S n ) ^ I(U;Z\S) 
±i SY (S n ;Y n ) -+ I(S;Y) 
±i UYls (U n ;Y n \S n ) ^ I(U;Y\S) 
^XY\us(X n ; Y n \U n S n ) -> /(X; F|?75) }> 
^xz|c/s(^ n ; Z"|[/"S") -► /(X; Z\US) 
±i zlxs (Z n \X n S n )^H(Z\XS) 
^z\us(Z n \U n S n ) -> 
in probability. Fix e > arbitrary and choose 

i?o = min{I(J7; Z\S),I(U] Y\S) + r} - 2e ' 
r = 7(5; Y) - 2e 

n = I(X; Y\US) - I(X; Z\US) - 2e 
r 2 =I(X;Z\US)-e. 

Then, it follows from ( TT~8T > and the definition of jmlx(e) that 
for the choice of (i?o, r, ri, r 2 ) in (T% , we have 

lim 7^ a ) x(e) = 0. (20) 



(19) 



For n = 1, 2, ■ 

7max(e)} 



-1/2 



71— >OC 

we choose block _B = _B„ so that £>„ 

TlB„ 



I -<*/—'-J—l 




/ = min {/(t/5;y), /(C/;ZI5)} 
h + /, = / (X;Y\ US) , I 2 = I(X; Z\ US) 

Fig. 7. Shapes of TZ ( s in) (U, X, S\T) and TZ^ n) (U, X, S\T). 



Define the sequence of block codes {(/„, {ffi}i=i; Vv ; ¥>t/) 

ir=i by 



constant, if 1 < v < B\ 



{fv,{9i}i=l,i>v,<Pl') = { (fnB n ,{9i}7=i^nB n ,(PnB n ), 

if nB n < v < (n + l)i? n+ i . 

Combining dl3l . (fT4T >. (flTt . and (1201) . we have that there exists 
a sequence of block codes {(/„, {<?i}^ =1 , ip v , fu)}^Li such 
that 



lim /Ltp = lim / ui""" ; < lim 7v/7me«(e) =0. 

i/— >-oo n— foo n— foo 



,(nB„) 



,(n) 



lim 4^ = lim ^2°"' < lim 7y/^(e) = 0, 

Urn i log 1X1= lim -l-logK?;) 3 "- 1 ! 
= Rq = min{7(C7; I(US; Y) - 2e} - 2e , 
lim -log|^|= lim -LlogKj;,) 5 "- 1 ! 

v— >oo ^ n— >oo 7li>ri 

= r 2 = /(X;2|C/5)-e, 
lim ilog|C|= lim J-logKA,)*"- 1 ! 

i/— >oo ^ n— >oo nlJn 

= n = - Zlt/S 1 ) - 2e , 

lim -H(L V \Z")= lim -LjT(4 B ») 

i/— >oo n— s-oo 1%JJ n 

> I(X; Y\US) - I(X; Z\US) - he . 

Since e can be arbitrary small, we obtain the desired result for 
the above sequence of block codes. Thus, the proof of Lemma 
Q]is completed. ■ 

C. Proofs of the Direct Coding Theorems 

In this subsection we prove 74 in) (r),7^ in) (r) C TL d {T) 
and ni in) (T) C K S (T) . Set 

n^(u,x,s\r) 

{(Ro,Ri,Re) : Ro 7 Ri,R c > 0, 
Ro < mm{I(US; Y), I(U; Z\S)} , 
Ro + Ri < I{X;Y\US) 

+ mm{I(U;Z\S),I(US;Y)} , 
Rc < Ri , 

R c < [I(X; Y\US) - I(X; Z\US)]+ .} , 



,(nB„) 



,(«) 



. Define by 

0„ , if i mod n = . 
constant, otherwise . 



A 
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and 



7^ in) (r)= y nW(u,x,s\r). 

(u,x,s)eVi 

Proof of TZ^ n) {T) C ^d(r) and Ui in) (V) C K S (T) : Set 

I = mm{I(US;Y),I(U;Z\S)}, 
h = /(X; r|CT5), J 2 = I{X\ Z\US) . 

We consider the case that 1\ > 12- The region 7Z(U, X, S\T) 
in this case is depicted in Fig. [7] We first prove 
7l d (T). From the shape of the region K d in) (U, X, S\T), it 
suffices to show that for every 

a£ [0,mm{I(US;Y),I(U;Z\S)}}, 

the following (Rq,Ri,R c ) is achievable: 

R = min{I(US; Y), 7/(17; Z\S)} - a , 

Ri = I{X;Y\US) + a, 

R c = I(X; Y\US) - I{X; Z\US) . 

Choose Tn and 7^' such that 

T — T' x T" 
lim -log 17^1 =mhi{/([/5;r),/([/;Z|5)}-a. 

n— foo fi 

We take 

K = % , /C„ = 7^' x J n x £„ . 
Then, by Lemma [T] we have 

lim |i4 = lim /ij = 0, 

n^roo n— >oo 

lim - log \fC n \ = I(X; Y\US) + a , 

n— »oo ft 

lim - log \M n \ = vam{I(US; Y), I(U; Z\S)} - a , 

n—toc fi 

lim -H(K n \Z n ) > lim -H(L n \Z n ) 

n— >oo 77, n— J-oo 77, 

> /(X;F|C/5) -7(X;Z|t/5). 

To help understating the above proof, information quantities 
contained in the transmitted messages are shown in Fig. [8] 
Next we prove 7?i m ^(r) C TZ S (T). From the shape of the 
region izi"^ (U, X, S\T), it suffices to show that the following 
(Rq,Ri,R c ) is achievable: 

Ro = mm{I(US; Y), I(U; Z\S)} , 
R x = R c = I(X; Y\US) - I(X; Z\US) . 

Choose f n : T n x J n x C n — > X n specified in Lemma [TJ Set 
M. n = T n and JC n = C n . Using this /„, for (m, fc) £ M. n x 
define 

/„(m, J„, fc) = x(m, J n , k) £ X n . 

The above /„ is no longer a deterministic function. It becomes 
a random function randomized by J n uniformly distributed on 
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Fig. 8. Information contained in the transmitted messages. 

J n , which works as a "dummy" random variable. It is obvious 
that this random function attains 

lim -\og\M n \ =mm{I(US;Y),I(U;Z\S)}, 

n— too fi 

lim -\og\K n \ =I(X;Y\US)-I(X;Z\US), 

n— too 77, 

lim -H(K n \Z n ) > I(X;Y\US) - I(X;Z\US) , 

n— >oc fi 

completing the proof. 



Proof of lil n) {T) C 7e d (r); Since 7& m; (r) C ft d m; (r), 

- (ir 1 
d 



> ( in ) / 



>( in )( 



we have TZ d ia) (T) C K d {T) 



Proof of l4 in) (T) C TZ S {T): Choose (U,V,X,S) £ Qi. 
The joint distribution of (U, V, X, S) is given by 

Puvxs(u,v,x, s) 
= Pusv{ u , s, v)p x \vi x \ v ) 7 (u,v,x,s) £U x V x X x S . 

Consider the discrete memoryless channels with input alphabet 
V x S and output alphabet y x Z, and stochastic matrices 
defined by the conditional distribution of (Y, Z) given V, S 
having the form 

r'(y, z\v, s) = ^2 T (V, z \ x -> s )Px\v(x\v) . 

Any encoder f' n : fC„ x M„ -t V™ for this new RCC 
determines a stochastic encoder /„ for the original RCC by 
the matrix product of f' n with the stochastic matrix given by 
Px\v = {Px\vi x \ v )}(v.x)eVxx- Both encoders yield the same 
stochastic connection of messages and received sequences, so 
the assertion follows by choosing the encoder f' n used for the 
proof of the inclusion 7^ in) (r') C Tl s {T'). ■ 
Cardinality bounds of auxiliary random variables in V\ and 
Qi can be proved by the argument that Csiszar and Korner 
[5] developed in Appendix in their paper. 

VII. Derivations of the Outer Bounds 

In this section we derive the outer bounds stated in Theo- 
rems We further prove Theorem [6] We first remark here 
that cardinality bounds of auxiliary random variables in Vi 
and Q2 in the outer bounds can be proved by the argument 
that Csiszar and Korner [5] developed in Appendix in their 
paper. 

The following lemma is a basis on derivations of the outer 
bounds. 
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Lemma 4: We assume (Ro,R\,R e ) £ 72.* (r). Then, we 
have 

Ro < i min{I(M n ;Y n ), I(M n ; Z n )} + 5 ljn 
Ri < ±I(K n ;Y n \M n ) + 5 2 , n 
Rc < [Ri-I(K n ;Z n \M n )}+ + S 3 , n 
Rc < [\l(K n ;Y n \M n ) 

- ±I(K n ;Z n \M n )] + +<5 4 ,„, 

where {^i,n}^=i> i= 1,2,3,4 are sequences that tend to zero 

as n — > oo. 

The above lemma can be proved by a standard converse 
coding argument using Fano's inequality. The detail of the 
proof is given in Appendix C. 

We first prove 72 d (T) C 72 d ° ut) (r). As a corollary of 
Lemma |U we have the following lemma. 

Lemma 5: We assume that (Rq, R±, R ) £ 72.* (T). Then, 

Ro < I min{/(M„; Y n ), I(M n ; Z n )} + S hn ) 
Ri < ±I(K n ;Y n \M n ) + 5 2>n 
Ro + Ri< \l(K n M n - Y n ) + 6 3>n 

Rc < [Ri - ±I(K n ; Z n \M n )]+ + 8 3>n 
Rc < [±I(K n ;Y n \M n ) 

- ±I(K n ;Z n \M n )] + +* 4 ,n ! 

' (22) 

where S 3 = 5 1>n + 5 2 , n - 

By this lemma, it suffices to derive upper bounds of 

I(M n ; Z n ),I(M n ; Y n ), I(K n ; Y n \M n ), 
I(K n M n ; Y n ), I(K n ; Y n \M n ) - I(K n ; Z n \M n ) 

to prove 72 d (r) C 72 d ° ut) (r). For upper bounds of the above 
five quantities, we have the following Lemma. 
Lemma 6: Set 



A 



U t = M n Y l ~ Z 



i—X nri—1 



1,2,- 



■ , n . 



For i = 1, 2, • ■ ■ , n, Ui, XiSi, and YiZi form a Markov chain 
Ui —> XiSi — > YiZi in this order. Furthermore, we have 

j i 

I(M n ;Y n )<Y,I{^S l ;Y i ), (23) 

i=l 
n 

I(M n ;Z n ) < Y I(U t \ Zi\Si), (24) 

i=l 
n 

I(K n M n ;Y n ) < Y I(XiSi\ YJ , (25) 

i=l 
n 

I(K n ; Y n \M n ) < Y I(X l ;Y l Z,\U l S t ) , (26) 
i=i 

I(K n ;Y n \M n ) - I(K n ;Z n \M n ) 

n 

K^HXiMZiUiSi). (27) 

i=l 

The bounds (f23b-(f26b also hold for any stochastic relay en- 
coder. If r belongs to the class NL, the bound ( |27] i also 
holds for any stochastic relay encoder. If f n is a deterministic 
encoder, we have 



I(K n ; Z n \M n ) > Y Zi\U t Si) 



(28) 



in addition to ([23]l-(|27]i. If T belongs to the class NL, the 
bound (|28l i also holds for any stochastic relay encoder. 
Proof of Lemma [6] is given in Appendix D. 

Proof of 72 d (r) C 72 d ° ut) (r) and K S (T) C 72i° ut) (r): 
We first assume that (Ro,Ri,R c )£ 72 s (r). Let Q be a 
random variable independent of K n M n X n Y n and uniformly 
distributed on {1, 2, • • • , n}. Set 

X = X Q ,S = Sn,Y = Yn,Z = Zn. 



Furthermore, set 



U = U Q Q 



Z < ^- 1 Y Q - 1 M„ 



Note that UXSYZ satisfies a Markov chain U 
By Lemmas [5] and [6] we have 



XS -> YZ. 



Ro 



Ro < mm{I(US; Y\Q),I(U; Z\SQ)} + S hn ) 

< mm{I(US; Y), I(U; Z\S)} + S hn 
Ri < I(X;YZ\US) + 5 2>n 
Rt <I(XS;Y\Q) + 8 3 , n 

= I(XS;Y) + ~S 3 ,n 
R e < I(X;Y\ZUS) + 8 4in . 



(29) 

Using memoryless character of the channel it is straight- 
forward to verify that U ->• XS -> YZ and that the 
conditional distribution of (Y, Z) given XS coincides with the 
corresponding channel matrix T. Hence, by letting n —> oo in 
<|29l we obtain (R , Ri, Re) £ 72^° ut) (r). Next we assume 
that (Ro, Ri, R e ) £ 72a (r). Then by Lemmas [5] and [6j we 
have 

Re < [Ri - I(X; Z\US)}+ + 5 3 , n (30) 

in addition to ( |29b . Hence by letting n -> oo in d29b and ( l3Qb , 
we conclude that (Rq, Ri,R c ) £ 72 d ° ut) (r). ■ 
Next we prove the inclusions 72 d (r) C 72 d ° ut) (T), 72 d (r) C 



72 d out) (r), and 72 s (r)C Tl^ m '(T). As a corollary of Lemma 
|4] we have the following lemma. 

Lemma 7: We assume that (Ro, Ri, R e ) £ 72.* (T). Then, 

Ro < \ mm{I(M n ; Y n ), I(M n ; Z n )} + 5i, n 
Ro + Ri< ±I(K n ;Y n \M n ) 

+i min{/(M n ; Y n ), I(M n ; Z n )} + d 3 , n 
R c < [Ri - ±I(K n ; Z n \M n )}+ + 5 3 , n 
Rc < [±I(K n ;Y n \M n ) 

-±I(K n ;Z n \M n )} + + S A , n . 

'(31) 

From Lemma |7] it suffices to derive upper bounds of the 
following five quantities: 

I(M n ;Z n ),I(M n ;Y n ), 

I(K n ; Y n \M n ) + I(M n ; Y n ) = I(K n M n ; Y n ) , 
I(K n ;Y n \M n ) + I(M n ; Z n ) , (32) 
I(K n ■ Y n | M„ ) - I(K n ■ Z n | M n ) . (33) 



, (out 



Since 



I(K n ;Y n \M n 
I(K n ;Y n \M n 



I(M n ;Z n ) 
I(K n ;Z n \M n 



I(K n M n ;Z n ), 
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we derive an upper bound of (|32l ) by estimating upper bounds 
of I(K n M n ; Z n ) and ((33). 

The following is a key lemma to prove TZ d (T) C ^ out) (r). 

Lemma 8: Set 

E/i = yfti^Mn , i = l,2,---,n, 

where 3S. i stands for Yi + {Yi + 2 ■ ■ ■ Y n . For i = 1, 2, ■ ■ • , n, 
Ui, XiSiZi, and Y. t form a Markov chain Ui — > XiZiSi —> Y± 
in this order. Furthermore, we have 

n 

J(M„; Y" n ) < £ /(l^Si; y ) , (34) 

i=l 

I(M n ;Z n ) <^2l(Ui;Zi\Si), (35) 

i=l 
n 

/(Jf„M„; Y" n ) < ^ I(XiUiSi; Yi) , (36) 

i=l 
n 

I{K„M n ; Z") < HXiUi; Z,\S,) . (37) 
i=i 

The bounds ([34-b - (f37T> also hold for any stochastic relay en- 
coder. If /„ is a deterministic encoder, we have 

I(K n ; Z n \M n ) 

n 

> ]T {/(X,; ZipiSi) - I(Ui\ ZilXiSi)} , (38) 

i=l 

I(K n ;Y n \M n )-I(K n ;Z n \M n ) 

n 

< {I(Xi; YiPiSi) - I(X i; Zi\UiSi)} , (39) 

i=l 

in addition to d34j-(l37l>. If T belongs to the class NL, the 
bounds (l38l and d39l also hold for any stochastic relay 
encoder. 

Proof of Lemma [8] is in Appendix E. 

Proof of TZ d (T) C 7^ out) (T): We assume that {R , 
Rx,Re)€ ^d(r). Let Q, X, Y, Z, S be the same random 
variables as those in the proof of 1Z S (T) C Tzi 011 ^ (T). Set 

U = U Q Q = Y$ +l Z ( l- 1 M n Q. 

Note that UXSYZ satisfies a Markov chain U -> XSZ -> y. 
By Lemmas [7] and [8] we have 

Ro<min{I(US;Y),I(U;Z\S)} + 5 hn 
Ro + Ri< I(X;Y\US) 

+ mm{I(US; Y),I(U; Z\S)} + ~6 3 , n 
Re < [Ri - I(X;Z\US) 

+I(U;Z\XS)}+ + 6 3 , n 
R c < [I(X; Y\US) - I{X- Z\US)]+ + tf 4 .„ . 

(40) 

By letting n — > oo in (1451 , we conclude that (Rq,Ri, R e ) 

en d out \v). m 

The following is a key lemma to prove TZ d (T) C 7^ d ° ut) (T). 

Lemma 9: Set 

Ui^Y^Z^Mn, i = l,2,---,n. 



For i = 1, 2, • ■ ■ , n, Ui, X^SiZi, and y form a Markov chain 
Ui —> XiZiSi —> Yi in this order. Furthermore, we have 

n 

I{M n ;Y n ) <Y,I{Ui;Yi) , (41) 

i=l 
n 

/(M n ;^ n )<£]/(Cr i ;Z < |S l ) > (42) 

i=l 

n 

/(iT„M n ; y") < I (X l S l ; Yi) , (43) 

i=l 
n 

I{K n M n ; Z n ) < ]T ^|^) . (44) 

i=l 

If /„ is a deterministic encoder, we have 

I{K n ;Z n \M n ) 

n 

> Y {I(Xi\ ZipiSi) - I{Ui; Zi\XiSi)} , (45) 

£=1 

I{K n ;Y n \M n )-I(K n ;Z n \M n ) 

n 

< {I(XiSi\ Yi\Ui) - I(XiSi; Zi\Ui) 

i=l 

+I(U i ;Z i \X i S i )} 

n 

= {IiXi-YipiSi) ~ I{Xi- Zi\UiSi) 
i=l 

+C(S 4 ; Y u Zi\Ui) + I(Uf, Zi\XiSi)} , (46) 

in addition to dfTTJ - dfSJ - The bounds (l4H(|43l, and (gUl also 
hold for any stochastic relay encoder. If T belongs to the class 
NL, the bound (l42l also holds for any stochastic relay encoder. 
If /„ is deterministic and T belongs to the class NL, the bounds 
(|4TTi-(|46*]i hold for any stochastic relay encoder. 

Proof of Lemma [9] is in Appendix F. 

Proof of TZ d (T) C ^ out *(r): We assume that (R a , 
Ri,R c )e 7^d(r). Let Q, X, Y, Z, S be the same random 
variables as those in the proof 7?. s (r) C ^ out - 1 (T). We set 

U = U Q Q = YQ- 1 Z% +1 M n Q. 

Note that UXSYZ satisfies a Markov chain U -> XSZ -> Y. 
Furthermore, if T belongs to the class NL, we have 

U -> XS -> Z, (47) 

which together with U -> XSZ -> Y yields 

U ^ XS ^YZ . 

By Lemmas |7] and |9] we have 

Ro<min{I(U;Y),I(U;Z\S)} + 6 hn 
Ra + Ri < I{X; Y\US) + mm{I(US; Y), 

I(U;Z\S) + C(S;Y,Z\U)} + 6 3 , n 
R c < [Ri - I(X;Z\US) 

+I(U;Z\XSQ)]+ + 5 3 , n 
= [R 1 -I(X;Z\US)]+ + S 3 , n 
R c < [I(XS; Y\U) - I(XS; Z\U) 
+I(U;Z\XSQ)]+ + 6 4 , n 
= [I(XS; Y\U) - I(XS; Z\U)]+ + S 4 , n . t 

(48) 
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Note here that since I(U; Z\XSQ) < I(U; Z\XS) and the 
Markov chain of (|47j, the quantity I(U;Z\XSQ) vanishes. 
By letting n — s- oo in d48l l, we conclude that (Po,Pi, P e ) 



e K 



5 ( out ) 



(T). 



The following is a key result to prove K S (T) C pj out) (r). 

Lemma 10: Let Ui, i = 1,2, ■••,n be the same random 
variables as those defined in Lemma [8] We further set Vi = 
UiSiK n . For i = 1, 2, • • ■ ,n, UiViXiSiZi satisfies the follow- 
ing Markov chains 



UA -^Vi^Xi. 
Furthermore, we have 



VtXi 



I{M n ;Y n )<J2l{UiSi;Y), 

i=l 
n 

I(M n ;Z n ) <J2 I(Ui\ Zi\Si), 
i=i 

n 

I(K n M n ; Y n ) < HViUiSi; Y) , 

i=l 
n 

I(K n M n ; Z n ) < I{ViUi; Zi\S t ) , 



I(K n ;Y n \M n )-I(K n ;Z n \M n ) 

71 

YsWV^YilUiSJ-IiViiZilUiSi)} . 



(49) 
(50) 
(51) 
(52) 

(53) 



The bounds d49b-(f52b also hold for any stochastic relay en- 
coder. If T belongs to the class NL, the bound d53l also holds 
for any stochastic relay encoder. 

Proof of Lemma \TU\ is given in Appendix E. 

Proof of TZ S {T) C Pi° ut) (r): Let Q, X, Y, Z, S, U be 
the same random variables as those in the proof of 7id(T) — 



7?4 out) (r). We further set V = USK„. Note that UVXSZ 
satisfies the following Markov chains 

U ->V -> XSZ -+Y ,US -+VX -+ Z, 
US -> X . 

By Lemmas [7] and [10] we have 

Ro < mm{I(US;Y),I(U;Z\S)} + 5 hn 
Ro + Ri< I{V-Y\US) 

+ mm{I(US; Y), /([/; Z\S)} + 8 3>n J> 

R c < Rl + 53 :Tl 

R C <I(V;Y\US)~I(V;Z\US) + S 4 , n . 
By letting n — >• oo in d54l l, we conclude that (Rq, Ri, R e ) 



e K 



(out) 



(T). 



Proof of Theorem® We assume that T belongs to the class 
NL. By Lemmas [5lfT0l and arguments quite parallel with the 
previous arguments of the derivations of outer bounds we can 
prove that TZ^ ut) (T), n ( ° ut) (r), and ^° ut) (r) serve as outer 
bounds of P*(r) and that pi° ut) (r) and Pi° ut) (r) serve as 
outer bounds of P*(r). ■ 



VIII. Derivations of the Inner and Outer Bounds 
for the Gaussian Relay Channel 

In this section we prove Theorem [7] Let (£i,£ 2 ) be a zero 
mean Gaussian random vector with covariance £ defined in 
Section V. By definition, we have 



6 = p y wj 1 



&11 , 



where £ 2 |i is a zero mean Gaussian random variable with 
variance (1 — p 2 )N 2 and independent of £1. We consider the 
Gaussian relay channel specified by S. For two input random 
variables X and S of this Gaussian relay channel, output 
random variables Y and Z are given by 



Y = X + S + & , 
Z = X + £ 2 = X ■ 



N 2t 



52|1 



Define two sets of random variables by 



V{Pi,P 2 



= {(U,X,S): E[X 2 ]<P l5 E[5 2 ]<P 2 
U -> XS -^YZ} , 



V G {Pi,P 2 ) = {(U, X, S) : U,X,S are zero mean 

Gaussian random variables. 
ELY 2 ] < P 1 , ELS 2 ] < P 2 , 
U -> XS -^YZ} . 

Set 

£f°(Pi,ft|E)= {(Ro,R u R e ) :R {h R 1 ,R e >0, 

Rq < mm{I(US;Y),I(U;Z\S)} , 

Ri < I(X;Y\US) , 

Rc < [Ri-I(X;Z\US)]+ , 

for some {U, X, S) G V G {P X , P 2 ) .} , 

£<° ut) (Pi,P 2 |£)= {(P ,Pi,Pe) :Ro,Ri,Rc>0, 

Ro < min{I(US; Y), I(U; Z\S)} , 

Pi < J(X;yz|[/s), 
p + Pi < iprsjy), 

Pc < [Pi - I(X; Z\US)}+ , 

R c < I{X-Y\ZUS) , 

for some (U,X,S) £ P(Pi,P 2 ).}, 



p( in )(P 1; P 2 |E) = {(Po,Pi,P c ) : Po,Pi,Pc > 0, 

R < mm{I{US; Y), I(U; Z\S)} , 

Rc<Ri<I(X;Y\US), 

P < I(X; Y\US) - I(X; Z\US) , 

for some (U, X, S) G V G (P U P 2 ) .} ; 



^ out )(P!,P 2 |S) = {(Po,Pi,P c ) :P o ,Pi,Pc>0, 

P < min{I(US; Y), I(U; Z\S)} , 

Po + Pi <I(XS;Y), 

R c < Ri < I(X;YZ\US), 

R c < I{X;Y\ZUS), 

for some (U, X 7 S) £ V(Pi,P 2 ) ■}■ 
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Then we have the following. 

Proposition 1: For any Gaussian relay channel we have 

HP (Pi , P 2 1 E) C 72d(Pi , P 2 1 E) C 7^ out) (Pi, P 2 |E) , 

£( in )(Pi,P 2 |E) C ^ s (Pi,P 2 |E) C ^(° ut )(Pi,P 2 |E). 

Proof: The first and third inclusions in the above propo- 
sition can be proved by a method quite similar to that in the 
case of discrete memoryless channels. In the Gaussian case 
we replace the entropy H(Z\XS) appearing in the definition 
°f Bz\xs.c by the differential entropy h(Z\XS). Similarly, 
we replace the entropy H(Z\US) appearing in the definition 
°f Bz\us,e by the differential entropy h(Z\US). On the other 
hand, Lemma [3] should be replaced by the following lemma. 

Lemma 11: For any Gaussian relay channels and for i = 
1, 2, • • • , B — 1, we have 



1 



> n 



H{L n 4L%- 1] Z nB ) 

- I(X;Z\US) -2e- 

» 

'Z\US,; 



3 + log e 



+ J(P 1 +N 2 )e 



(n) 

Z\US,i 



{ilog(27re7V 2 )} 



"'Z\XS,i ■ 



Proof of this lemma is in Appendix B. Using Lemma [TT] 
we can prove that Lemma [2] still holds in the case of Gaussian 
relay channels. Using this lemma, we can prove the first and 
third inclusions in Proposition Q] We omit the detail of the 
proof. 

We next prove the second and fourth inclusions in Proposi- 
tion [1] Let Q, X, Y, Z, S, U be the same random variables as 
those in the proofs of 1Z c i(T)C 7?.^ (T) in Theorem Q] and 
"K s (r)C7^° ut) (r) in Theorem!] Note that UXSYZ satisfies 
a Markov chain U -> XS — > YZ. We assume that (i? , 
Ri,R e ) G 1Z S ( Pi, P 2 |E). On the power constraint on X, we 
have 



^[x 2 ]=^±E[xf]< Pl . 



Similarly, we obtain E [S 2 ] < P 2 • Hence, we have ([/, X, 
S) G P(Pi, P 2 ). By Lemmas [5] and |6] we have ([29). Hence, by 
letting n -> oo, we obtain (P ,i?i,P e ) G 7^° ut) (Pi,P 2 |E) . 
Next we assume that (R ,Ri,R c ) G Ud(Pi, P 2 |E) . We 
also have (U,X, S) G P(Pi,P 2 ). By Lemmas and |6] we 
have (1291 and (f30b . Hence, by letting n — >• oo, we obtain 
(Po,Pi,Pe) G ^ out) (Pi,P 2 |E). ■ 
It can be seen from Proposition Q] that to prove Theorem [7] 
it suffices to prove 



74 in) (Pi,P 2 |E) C7^ in) (P 1; P 2 |£) 
^ in) (Pi,P 2 |E) C^ in) (P l7 P 2 |E) 

n [ r t] (Pi , P 2 1 S) C K ( d ° ut) (Pi , P 2 1 E) 



7^° ut) (Pi,P 2 |E) C ^ oux; (Pi,P 2 |E) 



(out) , 



(55) 



(56) 



Proof of (1551 1 is straightforward. To prove 
preparations. Set 



, we need some 



Define random variables Y, £i, and £ 2 by 



Y = aY + aZ, 

~ A . . 

Si = «Si + a?2 

6 = 6 - 6 = 



N 1 +N 2 -2p^N 1 N 2 



Let Ni = E[£ 2 l,i = 1,2. Then, by simple computation we 
can show that £i and £ 2 are independent Gaussian random 
variables and 

AT = (l-p 2 )^!^ 

1 N 1 +N 2 -2p y /N 1 N 2 ' 

N 2 = N 1 +N 2 - 2p^N 1 N 2 . 
We have the following relations between Y, Y, and Z: 

Y = X + aS + Zi 

Y = Y + a(S + £ 2 ) 
Z = Y-a(S + i 2 ) 



(57) 



The following is a useful lemma to prove 

Lemma 12: Suppose that (U, X, S) G V(Pi, P 2 ). Let X(s) 
be a random variable with a conditional distribution of X for 
given 5 = s. E X (s)['] stands for the expectation with respect 
to the (conditional) distribution of X(s). Then, there exists a 
pair (a,/3) G [0,1] 2 such that 

E s (E X(S) X(S)) 2 = aP 1 , 
h(Y\S) < ilog{(2^c)(aP 1 +7V 1 )} , 
h(Z\S) < ilog{(2^e)(aP 1+ 7V 2 )} , 
h(Y)<^\og{(2TTc)(P 1 +P 2 +2 x m\E + N 1 )} , 

h(Y\US) = ilog{(2^c)(/3aP 1 + JVi)} , 

h(Y\US) > ilog{(27re) (iSaPt + N ± )} , 

h{Z\US) > ilog{(27re) ((3aP 1 + N 2 )} . 

Proof of Lemma [T2] is given in Appendix G. Using this 
lemma, we can prove Theorem Q 

Proof of Theorem 0- We first prove (T55t . Choose (U, 
X, S) G V G such that 



ELY 2 
U -- 



=_Pu 

P 2 D 



E[51 =P 2 , 
Ft/, X = t/ 



where t/ and X are zero mean Gaussian random variables with 
variance Br)P\ and 6* Pi, respectively. The random variables S, 
U, and X are independent. For the above choice of (U, X, S), 
we have 



I{US-Y) = C {^±^^ 
I(U;Z\S) = C(-^ 



ep ± +N 2 J > 



N 1 +N 2 - 2 py/N 1 N 2 



I(X- Y\US) =C(9£), I(X; Z\US) = C (^) . 
Thus, ( TSBl l is proved. Next, we prove ( TSoT ). By Lemma [T2l we 
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have 



I(US;Y) = h(Y)-h(Y\US) 



^ r, [ (l- ) 3n)Pi+P2+2VaP 1 P 2 \ ,<- e s 



I(U;Z\S) = h(Z\S)-h(Z\US) 



< C 



aPi 



PatPi+N; 

I(XS;Y) = h(Y) - h(Y\XS) 

< q ^ (l-/3a)Pi+P2+2VgPiP 2 

I(X;Z\US) = h(Z\US)-h{Z\XS) 

I(X;YZ\US) = h(YZ\US)-h{YZ\XS) 
= h(YZ\US)-h(YZ\XS) 
= h{Y\US) + h{Z\YUS) 
-h(Y\XS)-h(Z\YXS) 

= h(Y\US) - h{Y\XS) 



(59) 
, (60) 
(61) 



C 



(l-p^)JVlJV 2 



(62) 



1 1 +N 2 -2p^/N 1 N 2 



where (a) follows from 

h(Z\YUS) = h(Z\YXS) = h(Z\YS) 
= ilog{(27re)a 2 iV 2 } . 

From doTT ) and d62l ), we have 



(l-p^)iV 1 iV2 



_ C ( S^l ) . (63 ) 



I{X;Y\ZUS) < C 

\ JV 1 + JV 2 -2p v /N 1 N 2 

Here we transform the variable pair (a, f3) € [0, l] 2 into 
(77, 9) € [0, l] 2 in the following manner: 



a a — 
= pa, r) = 1 — ■= = 



1 



(64) 

This map is a bijection because from (|64[) , we have 

Q 

a = l- 6f}> 6, 13 = -. (65) 

a 

Combining (|58]l-(|60]l, f®, $63^, and ||65}, we have (|56l). ■ 

IX. Conclusion 

We have considered the coding problem of the RCC, where 
the relay acts as both a helper and a wire-tapper. We have 
derived the inner and outer bounds of the deterministic and 
stochastic rate-equivocation regions of the RCC and have 
established the deterministic rate region in the case where 
the relay channel is reversely degraded. Furthermore, we have 
computed the inner and outer bounds of the deterministic and 
stochastic secrecy capacities and have determined the deter- 
ministic secrecy capacity for the class of reversely degraded 
relay channels. We have also evaluated the rate-equivocation 
region and secrecy capacity in the case of Gaussian relay 
channels. 

In this paper, we have focused purely on the derivation of 
information-theoretic bounds on the RCC. Problem of practical 
constructions of codes achieving the derived inner bounds of 



the RCC is left to us as a further study. Applications of LDPC 
codes to the wire-tap channel were studied in [31]. This work 
may provide some key ideas to investigate the code design 
problem for the RCC. 

Appendix 

In the following arguments, Zti stands for (X^ 1 , X™ +1 ). 
Similar notations are used for other random variables. 

A. Proof of Lemma [2] 

In this appendix we prove Lemma |2] 

Proof of Lemma [2} We first derive the upper bound of 



e^(l\wi) in Lemma |2 Set 



Pr{£ 2 ,,|Jti}^=Pr{£Ml^i} 



A 



A 



e^}{ti\4>n{U-{),k) 



Similar notations are used for other error probabilities. By 
definition of e^} and e 2 ™^, we have 



(n) 
2,i 



S (n) 
2 i 



< E 



5 (n) 
~2.i 



1 



_(n) 
e 2,/ 



\1~n I I \Jn 1 1 £n \ 



(t»,ti-i)er= 



(66) 

By the symmetrical property of random coding, it suffices to 
evaluate E[e$ (MMk-i), 1, 1)] and E[eg (lKfe-i))]. 
Note that 



E E S 2™ i^KiM) (f>n(ti-l) =Wi 



\w n \ 



= ]T E [e^(l\ Wi ) MU-i) 

-An) 



w. 



1 



|W n | 



(67) 



(68) 



On E[e 2 I 1, 1) \<j> n (U-i) = wi\, we have the following. 



[4"^l|wi, 1,1) U>„(*i-i) =Wi 



E 



^2 Ps{ s { w i))Pu\s(u(wi,l)\s(wi)) 



(s(wi),u(wi,l), £c(«j i ,l,l,l)eAf" 



x Px\us( x (wi, 1, 1, l)\u(wi, 1), s(Wi)) 
*Pz\xs(zi\x(wi, 1, 1, 1), s(wi)) 
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^2 Ps(s(w l ))p uz \ S (u(w t , l),Zi\s(tVi)) 



(s(wi) ,u(wi,l) , 



= Pr{(S n ,U n ,Z n )<fA uzl sJ • 
From d67| i and d69l ), we have 



(69) 



(l\Mti-i), 1)1 = Pr {(5", IT\ Z") i Aoz\aA 



(70) 



On E[e2™ \4> n (ti~i) = u>i]> we have the following. 

E [4?i C 1 !^) 4>n{U-l) = Wi 
< E E Ps( s ( w i))PC/|s(w(^i>*i)|s(^i)) 



ii^l (s(u)i),u(u)i,ti), 

Zi)e-4[/Z|S,e 



xPz\s{zi\s(wi)) 



(a) 



< E E Ps(s(w 4 )Wz|s(m(w 1; ^),2; 4 |s(w 4 )) 



Zi)G^[/ Z |s,£ 



x q— n[-Ro+<=] 



(s(?Wi),lA(KJi,ti), 

a«)6-^c/zis,e 



<- 2~ «[-Ro+e] ^2"-^° _ x) < 2~ ne 

Step (a) follows from the definition of Ajjz\s,e- From 
and dTTT i, we have 



(71) 



eg(ll^fe-i)) 



< 2" 



(72) 



Hence, form (|66l l, (f70l , and d72l we have 



„(n) 
2.i 



<Pr{(S n ,CT*,Z")^^ Z | S , e }+2- 



In a manner quite similar to the above argument, we can derive 



» 



and E 



the upper bounds of E 

El 

Next, we derive the upper bound of E 



stated in Lemma 



of el?' '„• and 



s(») 

'lb,i 



(n) 
'lb,j 



By definition 



e lb,i 

s(») 

e lb.i 



S (n) 
'lb.i 



< E 



we have 



;(") 
'lb,i 



1 



~(n) 
e lb,) 



\T n \ 2 \£ n \ 

x ^2 E e^(^_i|</)„(^_2),Zj-i) 
ii-i)eT„ 2 x£„ 

ffia E E [e£(Vi|^(V 2 )) 



(73) 

By the same argument as that of the derivation of ( |70] |. we 
have 

eXb,i(~ti-l\4>n(ti-2),k-l) 

= Pr{(S n ,U n ,Y n )iA UYls ,e} (74) 

for any (ti-i,ti-2,h-i) € 7^ 2 x C n . Then, from d73l and 
(l74l , we have 



;(") 
'lb,? 



Pr^t/™,!™)^^} . (75) 



Next, we evaluate E 



. By the symmet- 



rical property of random coding, it suffices to evaluate the 
above quantity for (fj_i,fj_2) = (1,1) or (1,2). When 
(ti-x,ti- 2 ) = (1, 1), set <p n (l) = Wi. Then, we have 

E [eg,(l|^(l))] = E [eg.(lK) 

^ E E E [ g Si(lki) ^(1) = MU-i 



xPr|0 n (l) = <^„(fi_i) = Wij 

E E E [4b!i(ii^) ^(i) = mI-i) = 



tu,£W„ 

1 



|W„| 2 ' 
On upper bound of 



(76) 



5 (») 
'lb,iV 



(l\wi) (j)„(l) = <j> n (ii-l) = Wi 



we have the following chain of inequalities: 

E [^bl^K) 0n(l) = 4>n(U-l) = Wi 



< E Ps(«K)) 

(s(u?i),it(?j;i,^_i), 
Vi_l)eXo-y|s, e 

xpu\s(u(wi,ii-i)\s(w i ))pr\ S (y i \s('Wi)) 



( a ) x 

< 2^ ps(«K)) 

_ 9— "[-Ro — r+e] 

X E P5C/y(s(^),M('^i,^-l),y i -l) 

< r)-n[_Ro-r+e] 



(77) 



Step (a) follows from the definition of AjjY\s,e- It follows 
from ( T76b and d77l i that when (tj_i,tj_2) = (1, 1), we have 



«&(iimi))] < E E 

o— n[i?o— r+e] 
<^ (nnRo _ i \ 9 9 — ne 

" ( j |Wn| " ' 



2~ n[i? — r+e] 



(78) 



When (^_i,ij_ 2 ) = (1,2), set <j> n {l) = w, and 0„(2) = 
Then, we have 



[4^(11^(2)) 



4t-(i|^-i) 



^ E E E [eSaK-i) = mu-i) 

0„(2) = io f _i 

■ {</>n(l) = <j>n(U-l) = Wi,(j) n (2) = Wj-ij 



xPr- 
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E E E [ft(%i-0 0n(l)=0n(*VO 

<£„(2) = 



|W„| 3 

+ E E [e£( 1 K-l)|0n(l) = 0n(2)=^- J 
1 



|w„| 2 ■ 

On upper bound of 

4b,i( 1 l' u, '-l) 'M 1 ) = 4>n{U-l) = Wi,<fi n (2) = Wi-i 

we have the following chain of inequalities: 



(79) 



(a) 
< 



4b!i( 1 l'" ; *-l)| = <t>n(U-l) = Wi,(f> n (2) = Wi-i 

E Ps(s(wi-i)) 



(s(u) i _i),ii(to i _i,t i _i), 

xpi/|s('"(«'i-ij^-i)|s(^i-i))py|s(Vi|s('«'t-i)) 
E Ps(s(^i-i)) 

(s(u) i _i),u(to i _i,t i _i), 
l/;_i)6*4[/v-|s, e 

xp [/y | S (t t ( U ; 4 _ 1 ,Li),y. t - 1 |^K-i))2-" [% - r+el 

2~ n[Ra — r+e] 



(a(tUi_i),tt(u)j_i,tj_i), 

y»-i)e^4t/Y|s,e 

< 2~ n[Ro— r+e] 



(80) 



Step (a) follows from the definition of AuY]S,e- On upper 
bound of 



4b i l) 0n(l) = 0n(2) = </>n(2) = U>i-1 



we have the following chain of inequalities: 

^lb^C 1 !^-!) </>n(l) = 4>n(2) = Wi,4> n (2) = Wi-l 

E Ps(s(w t -i)) 

(s(7fi— \),1l(wi — 1,2), 

xPc/|s(w(wi-i,2)|s(w i _i))py| S (y i |s(u; i _i)) 
( a ) x 

< E ps(sK_i)) 

(s(wi—i),u(wi — i ,2) , 

S/i_l)e^4.i7V|5,e 

xp c/y | S (M( W? _ 1 ,2),y 4 _ 1 | S ( W? „ 1 ))2-"[ % - I -+ £ ] 
x E PST/y(s(wi-i),u(u>i-i, 2), y^) 

),ix('UJi — 1,2), 

< 2"™[ ii o-r+e] _ 



Step (a) follows from the definition of AjjY\s,e- K follows 
from d79]>-([8TJ that when (^-1,^-2) = (1,2), we have 



4i(ii^(2))]< E E 

tVi/1,2 K,wi_i)e>v2 
2-n[Ko-r+e] 



2~ n[Ro— r+e] 

|W„| 3 



o — n[Ro— r+e] 

= (2 nR ° - 1) : : < 2 • 2~ ne . 

From (|73), C3l, (ESl, and (82j, we have 



(82) 



'lb,' 



<Pr{(5",[/",F")^^| S , e }+2-2- 



To derive the upper bound of E 



» 



in Lemma |2j set 



ej n) ^Pr{£},ej n) 4pr{£}, 



4 (jj|0n(*i-l),ii,^) 
— Pr{^ I -^n,i — j Tn.i— 1 ^i— 1 j ^n,? 
4 (ji|</>n(*i-l),*i,ii) 

By definition of and , we have 



E 




< E 


e i 


+ E 






'-(«)" 




1 






,) E 




\T n \ 2 \J n \\C n 





E E[e| n) (ji|0n(*i-i), ti,h) 



(ti,ti_i,jj,i<) 

er„ 2 xj„x£„ 

1 

|T„| 2 |J„||£„| 
E E 



e\ (ji\<l>n(ti-l),ti,k) 



(83) 

By the symmetrical property of random coding it suffices 
to evaluate E[^ n) (1|0„( ii_i),l,l)] and E[e| rl) (l# n ( 
f,_x),l,l)].Ina manner quite similar to that of the derivation 
of the upper bound of Efe^" (l|0 n (ij_i) ,1,1)] and E[e 2 "^ 
(1]0„ we obtain 

E[ej n) (lK(*i-i),M)] 
= Pr{(5 n ) C/",X",Z")^^l XZ | C/s , e } 

E[ei n) (l|0 n (i i _i),l,l)]<2-" £ . 
Hence we have 



» 



< Pr{(5",C/",X",^) £ ^z|c/s,e} +2" 



By an argument quite similar to that of the derivation of ( l70b . 
we can prove the formulas of E 



stated in Lemma [2] We omit the proofs 



and E 



'ZU\S,i 
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B. Proofs of Lemmas\3\and \ll\ 

Proof of Lemma\3$ On a lower bound of H(L n j\Ln 
Z nB ), we have the following chain of inequalities: 

H{L n Ml~ 1] Z nB ) 

= H{J,^L n , l \L^Z nB W n ^) 

-H(J nti \L nii L%-Vz nB W nti T n!i ) 
> H{J n ,iL n>i \L^ Z nB W n ,iT n ,i) 



Then, we have 



(84) 



By Fano's inequality, we have 



1 



H{J n ^\Z^ l ^'Wn,iT n< iL n ,i) < r 2 e 

From ( f84b and d85l ). we have 

H(L nA \L<j-Vz nB ) 
> H(J nti L n 4L^Z nB W nti T n 



(n) 



(85) 



nr 2 e 



(„) 



1 . (86) 



On the first quantity in the right members of (186b . we have 
the following chain of inequalities: 

= H(J n ,iL n ,i\L<£-Vz$f W„,iT„,i) 

— -^(^n(i-l)+l! J«,t^'n,i|-^'n ^ Zf B W n .iT n ,i) 

= H{J nti L n ,i\L^Z^W n ,iT n ^ 
+H{Z% i _ 1)+1 \Z$fW n , i T nti J n>i LV) 

-HiZZl^^ + ^Z^fWn.iTn.iJn^L^'^) 

= logdJnl |£„|) + i/(Z; i \V 1)+1 l4f W n , i T„, i J n , i LW) 
> n(n + r 2 ) - 2 + ff(^,_ 1)+1 |^f Wn.^Tn.iJ^LW) 

-fr(^_i) +1 |w nii r n>i ) 

( => n(n + ra) + ff(^ i _i) + i|W n , i T nii J nii L n , i ) 

-■ff(^(i-i)+i|W„ 1 ir n , < )-2. (87) 

Equality (a) follows from the following Markov chain: 

7 ni — v W T ■ T T \ 7"Bf('-l) 

To derive a lower bound of H(Z™^_ 1)+1 \ W n ^T n . t J Uji , L n ,i), 
set 

Bi = {{w,t,j,l,z) : 

(s(w),x(w,t,j,l),z) G #z|XS,e} • 

By definition of £>J\ if (w,t,j,l,z) e B{, we have 
n 

(n) 

By definition of e z ^ xs ., we have 

Pr{(W„,j, T„ t i, J n>il L n j, Z%fi-x)+i) & B*} = e^ixs,, ■ 



-l)+l|Wn,jT'„ i j J n ,iL nt i) 

> n[H{Z\XS) - e] 

X Pr{(Wjn,i) Tn,i, Jn,i,L n ,i, + £ i3i} 

> n[ff(Z|X5) -e](l -e {n) ^ 



Z\XS,i> 



> n[H{Z\XS) - e] - nH{Z\XS)e { ^ XS i ■ (88) 
To derive an upper bound of H(Z^ i _ 1 -. +1 \W n ,iT nt i), set 

#2 = {(«>,*>*) : (s(w),u(w,t),z) G B Z \ US ^} . 
By definition of B|, if (iy, t, z) G £>2, we nave 

logPz|trs(*|u(«;, t), s(w)) < H(Z\US) + e . 

(n) 

By definition of e Z \us p we nave 

Pr{(W n>i ,T n)i , Z%_ 1)+1 ) i B* 2 } = e^ US i . 



Set 



£> = {(w,t) : (w,t,z) G (S;) c for some z} 
and for (in, G 2?, set 

V(w,t)={z:(w,t,z)e(B* 2 r} ■ 
Then, we have 

<n[H(Z\US) + e}- £ £ Pz»w„t„ (*, w, t) 

(w,t)eV z£T>(w,t) 

X lOgp Z n lWriTri (z\w,t) . 



(89) 



We derive an upper bound of the second term in the right 
member of d89l . Let Z be a random variable uniformly dis- 
tributed on Z. Let Z n = (Zi, Z 2 , ■ ■ ■ , Z n ) be n independent 
copies of Z. We assume that Z n is independent of W n and 
T n , We first observe that 



- ^2PZ n W n T„{z,W,t)l0g 
(w,t)eT> z£T>(w,t) 

X] X] PZ"W n T n (z,W,t)\0g 



PZ"\W n T n (z\w,t) 

p zn (z) 

PZ"\W n T n (z\w,t) 



<( lo g c )- 2^ Z^PZ"W n T n (z,W,t) 
(w,t)eV z£T>(w,t) 

PZ"( Z ) _ 
_PZ"\W n T n (z\w,t) 

(loge)- ^ ^ [P^(«W„r n (io,*) 

(w,t)£T> z£T>(w,t) 
^PZ"W n T n ( z ^ w ^)} 

(logo) • [pz~w n T n (B* 2 ) - Pz~w n T n (B* 2 )] < logo. (90) 
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Step (a) follows from the inequality log a < (logc)(a — 1). 
From j90b , we have 

- X X PZ^W n T n {z,W,t)l0gp Z n lWnTn (z\w,t) 
(w,t)EV z£T>(w,t) 

< - X] ^2PZ"W n T n (z,W,t) log Pz^(z) +logC 

(w,t)ev zev(w,t) 
= n X X PZ"W n T n { z ^ w ^)^°E\ z \ +logc 

(tu, t)6'D z<ET>(w,t) 

= ne< z\us,i lo &\ Z \ + lo S e - 
Combining (f86l> - (f89b and ( 1911 , we have 

n 

>r 1 +r 2 -/(X;Z|C/5')-2e- 



(91) 



3 + log e 



{\og\Z\)e% s . + H{Z\XS)e^ xs . 



>r 1 +r 2 -I(X;Z\US)-2e 
(log |^|) 



3 + log c 



-r 2 e, 



(«) , Jn) 

Z\US,i ~*~ c Z\XS.i 



completing the proof. ■ 
Proof of Lemma [771 In a manner quite similar to the 
derivation of (186b and (l87l i in the proof of Lemma [3] we have 



H(L n!i \L%-Vz nB ) 

> H(J nil L n jL^Z nB W nil T n ^ - nr 2 ej n) - 1, (92) 

H(J n , i L n , i \L<t 1) Z nB W n ,a'n,i) 

> n(n + ra) + fe(^_i) +1 |W„,ir n>i J„ )i L nii ) 

-A^i-D+ilW-n^O-a. (93) 
On a lower bound of ^(^"(V^+il^n.^n.^n.^n.i), we have 

-l)+l|Wn,i^n,i"^n,i-C'n,i) 

> n[/i(Z|XS') - e] 

X Pr{(W nj i, Tn,ij <^n,ij in.ii € 23-^ } 

>n[/i(2|X5)-e](l-e^ s .) 

> - e] - nh{Z\XS)e { ^ XS i 

= n[h(Z\XS) -e]-n {\ log(27reiV 2 )} e^ xs % . (94) 

Next, we derive an upper bound of h(Z^J i _ 1 ^ +1 \W n .iT n: i). 
By definition of S 2 , if (w, t, z) g 2? 2 , we have 

-ilogpziusCzluKt), «(«;)) < h(Z\US) + e. 
Then we have 

<n[h(Z\US)+e\- X / Pz»w n r n (*>«>,*) 

xlogp Z n lWnTn (z\w,t)dz . (95) 

We derive an upper bound of the second term in the right 
member of d95l ). Let Z be a random variable whose density 



function denoted by p z (z) is 

Pz( z ) = \e~\'\ . 

Let Z n = (^i , Z%, ■ ■ ■ , Z n ) be n independent copies of Z. We 
assume that Z n is independent of W n and T n . For 2 = (z\, 
z 2, • • ■ , z n), the density function p Z n(z) of Z n is 

P^W=f^ n fl e " |Zil - 



In a manner quite similar to the derivation of d90l > in the proof 
of Lemma [3] we have 

ST f ( -Ai Pz"\w n T n (z\w,t) 
- V / Pz»w„t„ w,*) log ! ^ dz 

<loge. (96) 
From d96ll, we have 



X / Ps n w„T n (2,iM)logp z »|w nTn (2|tM)dz 



<- X / P^ n w n r n (^,iy,t)logP2n(z)dz + loge 
= n< ( X / Pz™w„t„ (z, iu, i)dz >+ log c 

((»,()657 j2 '('». i ) J 
+ ZZ f PZ"W„T n (z,W,t) \it\ Z i\ \ dZ - ^ 

On the last term in d97| i, we have the following chain of 
inequalities: 

X / pz"w n r n (z,w,t) I X N r dz 
(ffl , i)e p jl, f^ f ) U=i J 



- X ^ / Pz n w n T n (z,w,t)dz 



2 ^ 2 



(b) 

< 



< t/e 



/ Pz»w„r n (*,w,i) <Y]N ? dz 
X / Pz»w n T n (z,tM) < X N f d2: 

(w,t)GV Jv( - w ^ U=l J 



2 "\ 2 



2 2 



,(") 



(c) 

< \le 



,(«) 

'Z|t/S 



;Jn|p^(z)jX>| 2 ldz 



(n) 



n n X / z iPzM)^ 



(98) 
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Steps (a)-(c) follow from the Cauchy-Schwarz inequality. On 
the other hand, we have 



Y [ zfp Zi ( Zi )d Zi = ]T E [\Xi + 6,, 

i=l ^ i=l 

n n 

= ^E[|X t | 2 ] +^E[|6 



i=l 

< n(P 1 +N 2 ). 



(99) 



Combining (f92t-(f95b and (|97]i-(|99]l, we have 

-H(L n ^\L^Z nB ) 



>r 1 +r 2 -I{X-Z\US)-2e 

» 



3 + log e 



-r 2 e 



In) 
'Z\US,i 



(Pi + N 2 )e 



(n) 

Z\US,i 



-{ilog(2vreiV 2 )} e ^ ! 
completing the proof. ■ 

C. Proof of Lemma |4] 

Proof of Lemma [?} We first observe that we have the 
following chains of inequalities: 

log\M n \ = H(M n ) 

= I(M n ;Y n ) + H(M n \Y n ) (100) 
= I(M n ; Z n ) + H(M n \Z n ) , (101) 
log|£„| = H(K n ) =H(K n \M n ) 

= I(K n ;Y n \M n ) + H(K n \Y n M n ) , (102) 
H(K n \Z n ) = H(K n \Z n M n )+I(K n ;M n \Z n ) 
= H(K n \M n )-I{K n -Z n \M n ) 

+I{K n ;M n \Z n ) 
= I{K n -Y n \M n ) - I(K n - Z n \M n ) 

+H(K n \Y n M n ) + I(K n - M n \Z n ) 
< I{K n - Y n \M n ) - I(K n ; Z n \M n ) 

+H{K n \Y n M n ) + H(M n \Z n ) , (103) 
<log\K n \ -I{K n ;Z n \M n ) 

+H(K n \Y n M n ) + H(M n \Z n ). (104) 

Here, we suppose that (R , R 1: R c ) G TZ*(T). Set A< n > = 
max{X] n \ A 2 n ^}. Then, by Fano's inequality we have 

H(M n \Y n ) <log|M„|A(") + l 
H(M n \Z n ) <\og\M n \\^ +1 } 
H{K n \Y n M n ) < log \K n \ AW + l . 



Set 



ri, n = ilog|M n |A<* 



From dl00b -( 1105l ). we have 

ilog|X„| < imin{/(M„;y"),/(Af„;Z™)} + r 1 ,„ , 
i log \)C n \ < ±I(K n ;Y n \M n ) + r 2 ,„ 
\H{K n \Z n ) < ilog|/C„| - \KK n -Z n \M n ) 

+T\, n + T2, n 

±H(K n \Z n ) < ±I(K n ;Y n \M n ) - ±I(K n ;Z n \M n ) 

+Tl,n + T 2,n- 



(106) 



Set 



Si, n = n,n + [Po - ilog|7W„|] + 

^n+[i?l-ilog|/C„|] + 
«3,n = n, n + r 2 ,„ + [P c - ±ff(A'„|Z n )] " 

+ [ilog|/C„|-P 1 ] + 

<kn = T hn + T 2 ,n + [Rc - ±H(K„\Z n )] + . J 



A 



A 



(107) 



,„ = Ilog|/C„|A(«) + i 



It is obvious that when (Po, Ri, R e ) G P-s (T), the above Si tn , 
i = 1, 2, 3, 4 tend to zero as n — > oo. From (11061 ) and ( 11071 ). 
we have <|2U for (P , Pi, R c ) € fc*(r). ■ 



Z). Proof of Lemma [6] 

Proof of Lemma® We first prove (|23l and ( f24l ). We have 
the following chains of inequalities: 

I(M n ;Y n ) = H(Y n ) - H(Y n \M n ) 

n 

= Y {HiY^Y 1 - 1 ) - H(Y i \Y l ^ 1 M n )} 

n 

< {H(Yi) - HiYilY^Z^SiMn)} 

1=1 

n 

= Y.HUiSi-.Yi), 

i=l 

I(M n ; Z n ) = H(M n ) - H(M n \Z n ) 

n 

= Y {H{M n \Z*- 1 ) - H{M n \Z 1 )} 

i=l 
n 

( => Y {HiM^Z^Si) - H(M n \Z*)} 

i=l 
n 

< Y {HiM^Z^S,) - H(M n \Z l S t )} 

i=l 
n 

= Y^n^ilZ^Si) 

i=l 
n 

= Y {HiZilZ^Si) - H(Z l \Z l - 1 S t M n )} (108) 

n 

< Y {H(Zi\Si) - HiZ^-'Z^SM} 

i=l 
n 

= Y^^z^Si). 

i=l 

Step (a) follows from S t -> M n -t Z i_1 . Next, we prove 
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((25). We have the following chain of inequalities: 

I(K n M n ; Y n ) < I(X n ; Y n ) = W; X"^ 4 " 1 ) 

i=l 

n 

= {HiYilY'- 1 ) - HiYilY^X")} 

1=1 

n 

< {H(Y t ) - H(Y l \Y l ~ 1 X n S l )} 

i=l 

n n 

^— X] ~ H(Yi\XiSi)} = Y I (^iS i ;Y i ) 

i=l i=l 

Step (a) follows from Y n -> X n -> #„M„. Step (b) follows 
from -> -> Y l ~ 1 X^ . Thirdly, we prove ([26). We 

have the following chain of inequalities: 

J(K„ ; r"|M„) < I(K n ;Y n Z n \M n ) 

= I(K n M n ;Y n Z n \M n ) < F"Z"|M„) 
= #(X Tl |M n ) - F(X"|y"Z"A/„) 

n 

= ^ {ff(-X' n |y < ~ 1 Z < ~ 1 M n ) - H(X n \Y l Z l M n )} 
i=i 

n 

^ {ir(jr n |y*- 1 z i - 1 M n S() - ffpr|r 4 z l M„)} 

n 

< {HiX^Y^Z^MnSi) - HiX^Y'Z'MnS,)} 

i=l 
n 

= ]T {if(Y^|£/^) - H{YiZ i \UiS i X n )} 

i=l 
n 

- Z PS - HCr^ilA-^i)} 

i=l 
n 

»=i 

Step (a) follows from the Markov chain F n Z™ -> X™ 
lf„Af„. Step (b) follows from Si -> Z 1 - 1 -> X n Y l - x M n . 
Step (c) follows from Y^Zi — > Xj5i — ^ Ci-XVi] • Fourthly, we 
prove (1271) . We have the following chain of inequalities: 

I(K n - Y n \M n ) - l(K n - Z n \M n ) 

< I(K n ; Y n Z n \M n ) - I(K n ; Z n \M n ) 

= I(K n -Y n \Z n M n ) =I{K n M n ;Y n \Z n M n ) 

< I(X n ;Y n \Z n M n ) 

= H(Y"\Z n M n ) - H(Y n \Z n X n K n M n ) 

n 

= {H(Y t \Y t - 1 Z n M n ) - H{Y l \Y l - 1 Z n X n )} 
i=i 

n 

< {H(Y i \Y i ~ 1 Z i M n ) - H(Y t \Y t - 1 Z n S l X n )} 
i=i 

n 

- zZ {R(y i \Y i - l Z i S i M n ) - H{Y i \Y i - 1 Z n S i X n )} 

i=l 



n 

= J2 {HiYilUiSiZi) - HiYilUiS^SiX 71 )} 
i=i 

( = } WYilUiSiZi) - H(Yi\UiSiZiXi)} 
i=i 

n 

= ^/;.v, : v, z,r..sy>. 

i=i 

Step (a) follows from the Markov chain Y"Z n -> X" — » 
K n M n . Step (b) follows from that 5,; = ^(Z* -1 ) is a 
function of in the case where is restricted to 

be deterministic. In the case where {gi}™=i is allowed to be 
stochastic, if T belongs to the class NL, we have the following 
Markov chain: 

Si -> Z 1 - 1 -> y^ifnMn . (109) 

Step (b) follows from the above Markov chain. Step (c) follows 
from Y % -> -> F 4 " 1 ^]^] . Finally, we prove ([28). 

We have the following chain of inequalities: 

/(Jf„; Z n \M n ) = H(Z"\M n ) - H{Z n \K n M n ) 
( = ] H(Z n \M n ) -H{Z n \X n ) 

n 

= J2 {HiZi^Mn) - HiZilZ^X")} 
i=i 

n 

i=l 
n 

n 

- £ W W-Si) - H(Zi\XiSiUi)} 

i=l 

n 

i=l 

Step (a) follows from that /„ is a one-to-one mapping. Step 
(b) follows from that Si = gi(Z % ~ 1 ) is a function of in 
the case where {<7i}"=i is restricted to be deterministic. In the 
case where {<7i}" =1 is allowed to be stochastic, if T belongs 
to the class NL, we have the following Markov chain: 

Si -> Z' 1 - 1 -> Z l M n X n . (110) 

Step (b) follows from the above Markov chain. Step (c) follows 
from Zi -4 XiSi-^t Ui . Thus, the proof of Lemma [6] is 
completed. ■ 



E. Proofs of Lemmas \8\and \T0\ 

In this appendix we prove Lemmas [8] and [10] We first 
present a lemma necessary to prove those lemmas. 
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Lemma 13: 

n 

I(M n -Y n ) < YjI^+iZ^SiM^Yi) , (111) 



i=l 



I{M n ;Z n ) < Y^HY^Z^M^Z^Si), (112) 

n 

I(K n M n - Y n ) < J2 HY^Z^SiKnM^Yi) , (113) 

n 

I(K n M n ; Z n ) < J2 IiY^Z^KnMn, Z t \Si) , (114) 



= ^2 I{K n M n \ Z. l \Z' l ~ 1 Si) 
i=l 

n 

= Y {HiZilZ^Si) - B{Z,\Z^ 1 S l K n Mn)\ 
i=l 
n 

< J2 {H{Zi\Si) - HiZilY^Z^SiKnMn)} 

i=l 
n 

= Y. I ^ Z ^ lK nM n )Z t \S t ). 



i.= l 



i=l 



I(Y n ; K n \M n ) — I(Z n ; K n \M n ) 

n 

= {HKn, Y i \Y%_ 1 Z i - 1 M n S i ) 

i=l 

-IiK^ZtlY^Z^MnSi)} . (115) 
Proof: We first prove (II 1 11 1 and ( II 12l i. We have the follow- 
ing chains of inequalities: 



I(M n ;Y n ) =^2{H(Y i \Y^ l )-H(Y t \Y^. 1 M n )} 

n 

< Y {H(Yi) ~ H(X\YZ_ 1 Z i - 1 SiM n )} 

i=l 
n 

= Y. I{ y^ zi ~ ls i M ^Yi), 

i=l 

I(M n ; Z n ) < {HiZilZ^Si) - E{Z i \Z i - x S i M n )) 

i=l 
n 

< Y, {H{Z l \S l ) - HiZilY^Z^SiMn)} 

i=l 
n 

= YHY^Z^M^ZilSi). 
i=i 

Step (a) follows from (1108b . Next, we prove (1113b and (1114b . 
We have the following chains of inequalities: 

I(K n M n ;Y n ) = H(Y n ) - H(Y n \K n M n ) 

n 

= Y {H(Yi\Y^) - H(Y t \ Fj™ 1 K n M n ) } 

i=l 
n 

< Y { H (Yi) - HiYilY^Z^StKnMn)} 

i=l 
n 

= ^/(^+i^ 1 5 i A'„M n ;y i ), 
i=i 

I(K n M n -Z n ) 
= H{K n M n \Z n ) - H{K n M n \Z n ) 

n 

= Y {H{K n M n \Z l - x ) - H{K n M n \Z*)} 

i=i 

n 

< Y {H{K n M n \Z l - x ) - H{K n M n \Z*S,)} 



(a) 



Y {H(K„ M n \Z i ~ l S l ) - H(K n M n \Z l S t )} 



Step (a) follows from Si — >• Z l 1 — >• K n M n . Finally, we 
prove ( II 15b . We first observe the following two identities: 

H(Y n \M n ) - H(Z n \M n ) 

n 

= E {HiY^Y^Z^Mn) - HiZ^Y^Z^Mn)} ,(116) 

i=l 

H(Y n \K n M n )-H(Z n \K n M n ) 

n 

= Y{H(Y l \YJl 1 Z<- 1 K n M n ) 



-HiZilY^Z^KnMn)}. 



(117) 



Those identities follow from an elementary computation based 
on the chain rule of entropy. Subtracting dl 17b from dl 16b . we 
have 

I(Y n ;K n \M n )-I(Z n ;K n \M n ) 

n 

= Y{l(Kn;Y i \Y? +l Z i - l M n ) 

i=l 

-HK^Z^Y^Z^Mn)} 

n 

= Y {-tt{K n \Y?Z l - x M n ) + H{K n \Y; l +1 Z l M n )} 



i=l 



< Y { ~H(K n | Y™ Z i_1 M n St ) + H{K n \Yr +l Z l M n )} 



i=l 



(a) 



Y {-H(K n ; lYPZ^MnSi) + H{K n \Yr +1 Z l M n S t )} 



i=l 



= Y{ I (K n ;Y l \Y^ 1 Z' l - 1 M n S l ) 

i=l 

-HK^ZilY^Z^MnSi)} . 

Step (a) follows from that Si = g^Z 1 ^ 1 ) is a function of Z l ~ x 
in the case where {<?i}f =1 is restricted to be deterministic. In 
the case where {<?i}f =1 is allowed to be stochastic, if T belongs 
to the class NL, we have the following Markov chain: 

S l -> Z*- 1 -> ZiYp +1 K n M n . (118) 

Step (a) follows from the above Markov chain. ■ 
Next, we present a lemma necessary to prove Lemma [8] 
Lemma 14: For any sequence {Ui}" =1 of random vari- 
ables, we have 

n 

I(K n M n ; Y n ) < Y I{XiUiSi;Yi) , (119) 

i=l 
n 

I(K n M n ; Z n ) < Y I (X t U l ; Z t \Si) . (120) 
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Proof: We first prove dl 19b . We have the following chain 
of inequalities: 

I(K n M n ;Y n ) < I(X n ;Y n ) = H(Y n ) - H{Y n \X n ) 

n 
n 

< J2 {H(Y) - H^Y^^S,)} 



(b) 



< {H(Y) - H&ilXiUiSi)} = I(XiUiSi; Yi) . 

i=l i=l 

Step (a) follows from the Markov chain Y n X n K n M n . 
Step (b) follows from Y t ->• Y l ~ 1 X^ . Next, we 

prove (|120| i. We have the following chain of inequalities: 

I(K n M n ; Z n ) < I(X n ; Z n ) = H(X n ) - H(X n \Z n ) 

n 

= {H(X n \Z t - 1 ) - H{X n \Z 1 )} 



< {HiX^Z 1 - 1 ) - H(X n \Z t S l )} 
i=i 

n 

( = ] J2 {H(X n \Z , - 1 S l ) - H{X n \Z l Si)} 
i=i 

n 

i=i 

n 

= Y {HiZilZ^Si) - H(Z t \Z*X n S t )} 

i=l 
n 

^^{HiZilSd-HiZilXiSi)} 

i=l 

n n 

< Y {H(Zi\Si) - HiZilXiUiSi)} = Y HXiUf, Z t \Si) . 
i=i j=i 

Step (a) follows from the Markov chain Z n -> X n -> K n M n . 
Step (b) follows from 5, -> Z 1 - 1 -> X n . Step (c) follows 
from Zi — > -XjSj — > Z % ~ x Xu\ . Thus, the proof of Lemma [T4l 
is completed. ■ 
Proof of Lemma \8± Set [/< = i^Z^Mn. It can easily 
be verified that Ui, XiSiZi, Yi form a Markov chain Ui —> 
XiSiZi -t Y z in this order. From (fTTTb . ( TPT21 . and (fTT3T > in 
Lemma [T3l we obtain 

I(M n ;Y n ) <J2l(UiSi;Yj, 

1=1 

n 

HM^Z") K^HUnZilSi), 

t=i 

/(r rl ;^„|M„)-/(Z";X„|M„) 
< Filf/^) - /(#„; , (121) 

i=l 



and 



(a) 



respectively. From dl 19K d!20t in Lemma [T4l we obtain 

n 

I{K n M n ;Y n ) < ^(XiUiSiiYi), 
i=l 

n 

I(K„M n ;Z n ) < ^HXiUnZ^Si), 

i=l 

respectively. It remains to evaluate an upper bound of 

I{K n ; Y t \U t Si) - I(K n ; Z % \U,S t ) . 

We have the following chain of inequalities: 

IiK^YipA) - IiK^ZipA) 
= H(Y t \U t Si) - H(Yi\K n M n UiSi) 
-HiZipiSi) + HiZilKnMnUiSi) 

H(Yi\U i S i )-H(Y i \X n U i S i ) 
-HiZipiSi) + H(Zi\X n UiSi) 
H(Y l p l S i ) 

-H(X\ZiX n UiSi) - I(Y t ; Z t \X n U t S t ) 
-HiZipiSi) 

+H{Z l \Y l X n U l S l ) + I(Y; Z t \X n U t S t ) 
H{YipiSi) - H{Y l \Z l X n U l S t ) 
-H(ZipiSi) + H{Z l \Y l X n U l S l ) 

H{Y l p l S i ) - H(Y i \Z i X l S l ) 
-H(ZipiSi) + H{Z i \Y i X n U i S i ) 
< H(YipiSi) - HpTilZiXfUiSi) 

-H(ZipiSi) + H(Z t \YX t U t Si) 
= I(Y; ZiXipiSi) - IiZi-YiXipiSi) 
= I(X i; YipiSi) - I{X i; ZipiSi) . 

Step (a) follows from X n = f n (K n ,M n ) and /„ is a one- 
to-one mapping. Step (b) follows from Yi — > ZiXiSi — > 
UiXut . Finally, we prove d38l ). We have the following chain 
of inequalities: 



(b) 



(a) 



I(K n ; Z n \M n ) = H{Z n \M n ) - H{Z n \K n M n ) 
H(Z n \M n ) - H{Z n \X n ) 

n 

{HiZilZ^Mn) - H{Z i \Z i - x X n )\ 



~ zt {HiZ^-'SM - HiZilZ^SiX")} 

i=l 
n 

> {HiZipA) - HiZilXA)} 

i=l 
n 

= YiH^ZipiS^-iiu^ZiiXiSi)} . 

Step (a) follows from that /„ is a one-to-one mapping. Step 
(b) follows from that 5, = gi(Z' l ~ 1 ) is a function of Z 1 ^ 1 in 
the case where {<?i}f =1 is restricted to be deterministic. In the 
case where is allowed to be stochastic, if T belongs 

to the class NL, we have the following Markov chain: 



St -> Z 1 - 1 -> Z l M n X n . 



(122) 
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Step (b) follows from the above Markov chain. ■ 
Proof of Lemma [701- This lemma immediately follows from 
Lemma Qj] ■ 

F. Proof of Lemma [9] 

In this appendix we prove Lemma [9] 

Proof of Lemma $ Set Ui = Y i_x Z? + 1 M n . It can easily 
be verified that Ui, XiSiZi, Yi form a Markov chain {/, — > 
XiSjZi — > Yi in this order. In a manner similar to the proof 
of Lemma [T3l we obtain the following chains of inequalities: 

n 

I(M n ;Y n ) =Y,{H(Y i \Y i - 1 )-H(Y i \Y i - 1 M n )} 

i=l 
n 

i=l 
n 

i=l 

I(M n ;Z n ) = H(Z n ) - H(Z n \M n ) 

n n 

= HiZ^- 1 ) J2 H(Z t \Z? +1 M n ) 

i=l i=\ 
(a) n 

< {H(Zi\Si) - H(Z z \Z? +1 M n )} 

1=1 

n 

< {H{Z l \S i ) - HiZ^-'Z^SM} 

1=1 

n 

= YHY^Zi+iM^ZilSi). 

2=1 

Step (a) follows from that Si = gi(Z % ~ x ) is a function of Z' 1 ^ 1 
in the case where {<?i}™ =1 is restricted to be deterministic. In 
the case where {<?i}™ =1 is allowed to be stochastic, if T belongs 
to the class NL, we have the following Markov chain: 



Si -> Z'- 1 -> Z t M n X r 



(123) 



Step (a) follows from the above Markov chain. Hence, we 
have 



I(M n ;Y n )<Y,m;Yi), 

i=l 
n 

I(M n ;Z n ) ^Y^ZilSi 



Furthermore, by taking {[/,}" =1 be constant in ( 11 19b . ( 1120t in 
Lemma [Pfl we obtain 

n 

I(K n M n ;Y n ) K^HXiSiM), 

i=l 
n 

i=l 

respectively. It remains to evaluate an upper bound of 

I(K n ;Y n \M n )-I(K n ;Z n \M n ). 



Since f n is deterministic, we have 

I(K n ; Y n \M n ) - I(K n ; Z n \M n ) 
= H(Y n \M n ) - H{Z n \M n ) - H{Y n \X n ) 

+H(Z n \X n ). (124) 

We separately evaluate the following two quantities: 

H(Y n \M n ) - H(Z n \M n ),H(Y n \X n ) - H(Z n \X n ). 
We observe the following two identities: 

H(Y n \M n ) - H(Z n \M n ) 

n 

= E {HiYlY^Z^M - HiZilY^Z^MJ} , (125) 

i=l 

-H{Y n \X n ) + H{Z n \X n ) 

n 

= {-HiYlY^Z^X") + HiZilY^Z^X™)} .(126) 

i=l 

Those identities follow from an elementary computation based 
on the chain rule of entropy. From ( |125t , we have 



(127) 



H(Y n \M n ) - H(Z n \M n ) 

n 

YiHiYilU^-HiZipi)} 



i=l 



Next, we evaluate an upper bound of 

-H(Y i \Y£_ 1 Z i - 1 X n ) + HiZilY^Z^X 71 ) . 

Xui . We have the following chain of 



A 



Set Ui 
inequalities: 



y^+iZ 1 - 1 



< 



H(Yi 
H(Y 
H(Y 

( =' -H(Yi 
= -H{Yi 
+H(Z, 
= -H(Yi 

( ^ -H( Yi 
< -H(Yi 
= -H(Yi 



\Y? +l Z l -'X n ) + H(Zi\Y? +1 Z l -^X n ) 
\XiUi) + HiZilXiUi) 
\XiSiUi) + H{Zi\XiUi) 

\X i S i U i ) + H{Zi\X i SiU i ) 
IZiXiSiUj + I^ZilXiSiUi) 
\YiXiSiUi) — I{Yi\ Zi\XiSiUi) 
\Z l X l S l U l )+H{Z l \Y l X l S l U l ) 

\ZiXiSi) + H(Zi\YiXiSiUi) 
\ZiXiSi) + H(Zi\YiXiSi) 
\XiSi) + I(Y i5 Zi\XiSi) 
+H(Z l \X l S i )-I{Y l ;Z l \X l S l ) 
-H{Yi\XiSi) + H{Zi\XiSi) . 



(128) 



(129) 



Step (a) follows from that Si = gi(Z l ~ l ) is a function of 
in the case where is restricted to be deterministic. In 

the case where {.g;}" =1 is allowed to be stochastic, if T belongs 
to the class NL, we have the following Markov chain: 



Si 



Z 1 



ZiYr +1 x n . 



(130) 



Step (a) follows from the above Markov chain. Step (b) follows 
from Y t ZiXiSi Ui . Combining CGI, <fl2"6l (TTf\ , and 
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( 11291 ), we obtain 

I(K n - Y n \M n ) - I{K n ; Z n \M n ) 

n 

<J2{H(Yi\Ui) - H(Zi\Ui) 

-HWXiSt) + H (ZilXtSi)} 

n 

<Y^{H(Xi\Ui) - H{_Zi\Ui) 
i=i 

-H{Y i \X i S i U i ) + H{Z i \X i S i )} 

n 

= Y^{I(XiSi\ Yi\Ui) - I(XiSi; Zi\Ui) 
+I(U i ;Z i \X i S i )} 

n 

= ^{/(X i; Yi\UiSi) - I(X q - ZipiSi) 
i=i 

Yi, Zt\Ui) + I(Ui\ ZilXiSt)} . 

Finally, we prove d46b . We have the following chain of 
inequalities: 

I(K n ; Z n \M n ) = H(Z n \M n ) - H(Z n \K n M n ) 
^ H(Z n \M n ) - H(Z n \X n ) 

n 

= {H(Zi\Z? +1 M n ) - E{Z i \Z i - 1 X n )} 

i=l 
n 

{ = ] {H(Zi\Z? +1 M n ) - HiZilZ^SiX")} 

i=l 
n 

> Y,{H{ z i\ u iSi) - H{Zi\XiSi)} 

i=l 
n 

= ZipiSi) - I(Ui; ZilXiSi)} . 

i=l 

Step (a) follows from that /„ is a one-to-one mapping. Step 
(b) follows from that Si = g^Z 1 ^ 1 ) is a function of Z' 1 ^ 1 in 
the case where {<7i}"=i is restricted to be deterministic. In the 
case where {ffi}" =1 is allowed to be stochastic, if T belongs 
to the class NL, we have the following Markov chain: 



Si -> Z l ~ l -> Z,X 7 



(131) 



Step (b) follows from the above Markov chain. Thus, the proof 
of Lemma [9] is completed. ■ 



G. Proof of Lemma [72] 

We first observe that by the Cauchy-Schwarz inequality we 
have 



^E X(S) X2(S)^E 



Es (Ex(S)X(S)) < E5 

= E S E X(S) X 2 (5) < P 1 
Then, there exits a £ [0,1] such that 

E s (E X(S) X(S)) 2 =aP 1 . 



We derive an upper bound of h(Y). We have the following 
chain of inequalities: 



h(Y) = h(x + s + a) 

< ilog{(27re) (E XS \X + S\ 2 + Ni)} 

= \ log {(27rc) (ExX 2 + 2E, X sXS + E S S 2 - 

< I log {(2™) (P 1 +P 2 + 2E XS XS + N 1 )} 

By the Cauchy-Schwarz inequality we have 
ExsXS = Es [SEjf^X (S*)] 



(132) 



< VEsS*yfEs (Ex(s)X(S)) = v^V^Pi- (133) 

From ( 1132b and ( 1133b , we have 

h(Y) < i log { (27re) (Pj + P 2 + V^Pj^ + Ni) } . 

Next, we estimate an upper bound of We have the 

following chain of inequalities: 

h(Y\S)=E s [h(X(S)+^)] 
< E S [i log { (2ttc) (V X (s) [X(S)] + Ni) }] 



Es 



< 



ilog{(27r C )(E A - ( s)[X 2 (5)] 
E X{S )X(S)) 2 + N^} 

[X 2 (S)} 



(134) 



_ ilog{(27re)(EsE x( s) 

-E s (E X(S) X(S)) 2 +N 1 ' S )} 
< |log{(27re) (aPx+Nx)} . 
Similarly, we obtain 

h(Z\S) < ±log{(27re) (aPi + N 2 )} , 
h{Y\S) < \ log {(27re) (o.P x + N^j } 

Since 

h(Y\S) > h(Y\XS) = \ log {(2ttc)JVi} 

and ( 1134b . there exists /3 G [0, 1] such that 

fc(y |E/S) = § log {(27re) (^aPi + Ni) } . 

Finally, we derive lower bounds of h(Y\US) and h(Z\US). 
Let s) be a random variable with a conditional distribu- 
tion of Y for given (£/, 5)= (u, s). Similar notations are used 
for Y and Z. From the relation d57l i between X, S, Y, Z, and 
Y, we have 

Y(u, s) = Y(u, s) + a{s + &) , (135) 
Z(u,s) = i > (u,s)-a(s + 6). (136) 

Note that y(it, s) is independent of £2- Applying entropy 
power inequality to ( 1135b and ( 1136b , we have 



_J_2'2h(Y(u,s)) > 1 n 2 h(Y(u,s)) 

2lTC — 27TC 



1 r ) 2h(a(s+£ 2 )) 
2ttc 



1 n2/i(Y(ti,s)) 
2irc 



2ttc — 2-7TC ' 2-ttc^ 



_i_ 2 2/ l (y( u , s) ) + fl 2^ 2 
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from which we have 

fr(y(u,«))>Fi(&(y(u,s)) 

h{Z(u,s)) > F 2 (h(Y(u,s)) 

where 



(137) 
(138) 



fi(7) = ^log ( 227 + (27rc)a 2 iV 2 
^2(7) = ^log (2 27 + (27re)a 2 iV 2 

By a simple computation we can show that ^(7), i = 1, 2 are 
monotone increasing and convex functions of 7. Taking the 
expectation of both sides of (I137l i with respect to (U, S), we 
have 



h{Y\US) 

E us [MWS))]>E ra 



(a) 

> Fi ( E[/5 



Fx (h(Y(U,S)) 
F\ (h(Y\US) 



±log{(27rc) ^aP] 
±log{(2™) (/3aP 



1 + iVi + a 2 /V 2 ) I 

(l-p 2 )N 1 N 2 



N 1 +N 2 -2py/N 1 N 2 
Nf+p^N 1 N 2 -2pN 1 



N 1 +N 2 -2p^/N 

= ilog{(2 TC )(/3aP 1 +iV 1 )} . 

Step (a) follows from the convexity of Pi (7) and Jensen's 
inequality. Taking the expectation of both sides of ( 1138b with 
respect to (U,S), we have 

h(Z\US) 

= E us [h(Z(U, S))] > E us [f 2 (h(Y(U, S)) 
> F9 ( Err« \h(Y(U. S))]] = F 2 (h(Y\US) 



F 2 (e us [h(Y(U,S)) 
\ log {(2™) (paPi + N X + a 2 iV 2 ) } 
ilog{(27re) (/3aP 



N 1 +N 2 -2p^N 1 N 2 
N^+p J N 1 N 2 -2pN 2y 



i» 2 y / 



iVi+iV 2 -2pvTv; 

= ilog{(2™)(/3aP 1 +iV 2 )} . 

Step (a) follows from the convexity of -^2(7) and Jensen's 
inequality. Thus, the proof of Lemma Q~2] is completed. ■ 
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